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FOREWORD 


This  report  Is  the  second  of  three  documents  resulting  from  research 
conducted  by  the  System  Development  Corporation  (SDC)  for  the  U.S.  Army 
Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  under 
contract  number  DAHC  19-76-C-0027:  "The  Effectiveness  of  Alternative 
Media  in  Conjunction  with  TEC  for  Improving  Performance  in  MOS  Related 
Tasks."  Mr.  Arthur  Marcus,  ARI,  was  the  technical  contract  monitor  for 
the  work  reported  here. 

Ihls  particular  document  addresses  planning  for  the  utilization  of 
TEC  media  in  the  proximal  future,  FY  78-83.  The  research  was  conducted 
in  response  to  HEM  77-185  sponsored  by  the  US  Army  Field  Artillery  School 
(USAFAS).  The  first  report,  API  TR-77-A20,  "The  Effectiveness  of 
Alternative  Media  in  Conjunction  with  TEC  for  Improving  Performance  in 
MOS  Related  Tasks,"  was  published  December  1977. 

As  background  to  the  development  of  this  effort,  the  precursors  to 
HEN  77-185  were  two  previous  HRN's:  76-205  initiated  by  the  Combat  Army 
Training  Board  and  an  unnumbered  HRN  initiated  in  FY  1975  by  the  US  Army 
Infantry  School  (USAIS).  It  was  anticipated  in  FY  1977  that  the  USAIS 
could  provide  necessary  support  for  their  HRN;  however,  changing 
priorities  prevented  the  Infantry  School  from  providing  the  required 
support.  However,  the  USAFAS  was  acquainted  with  the  research  capability 
of  API  through  ARI  contributions  to  the  TACFIRE  Program  and  was  receptive 
to  the  potential  value  of  an  HRN  which  would  support  computer  aided 
instruction  with  application  to  training  in  artillery  weapon  systems  and 
thus  undertook  sponsorship  of  the  effort. 

Brigadier  General  Albert  B.  Akers,  Deputy  Commandant  of  the  USAFAS, 
directed  the  development  of  HRN  77-185,  which  provided  USAFAS  support. 
Colonel  John  S.  Crosby  (now  PC  Crosby,  Director,  Personnel  Information 
Systems,  US  Army  Military  Personnel  Center)  provided  guidance,  assistance 
and  support  for  the  ARI  research  effort  at  the  Field  Artillery  School  as 
Director,  Course  Development  Field  Artillery  School  Brigade.  Colonel 
Crosby's  Directorate  provided  the  personnel  and  logistic  support  which 
enabled  ARI  to  accomplish  the  necessary  research  for  these  reports. 

A desirable  end-product  from  any  research  effort  is  spinoff  data 
which  may  help  to  satisfy  goals  beyond  the  immediate,  stated  objectives 
of  a given  study.  Such  is  the  case  in  this  instance.  Ihe  Educational 
Technology  and  Training  Simulation  Technical  Area  has  as  one  objective 
in  its  exploratory  development  program  (RDTE  category  6.2)  the  creation 
of  a general  model  to  assist  training  device  developers  in  evaluating 
and  selecting  instructional  media  on  the  basis  of  cost  and  training 
effectiveness  (see  ARI  FY  78  Work  Program,  Project  A764,  Task  A,  Work 
Unit  2).  The  results  reported  here  will  feed  directly  into  this  DEMO 
(device/media  optimization)  model  development  effort. 
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EXECUTIVE  SUMMARY 


The  current  emphasis  on  a first-battle-win  readiness  posture  demands 
realism  of  situational  training,  active  response,  and  sustaining  prac- 
tice; yet  this  readiness  posture  must  be  less  demanding  than  traditional 
techniques  on  costly  or  scarce  resources.  Concern  for  finding  the 
optimum  ratio  of  training  systems  to  resources  is  evidenced  by  the 
variety  of  delivery  systems  fielded  or  in  various  stages  of  investi- 
gation by  USAFAS  and  other  DA/TRADOC  groups.  The  long-range  objectives 
of  the  current  effort  are  to  develop  practical  procedures,  data  sources, 
and  a resource  management  approach  for  selection  or  assignment  of 
optimal  training  delivery  system  mixes.  These  delivery  systems  would  be 
directed  toward  major  individual-collective  training  and  evaluation 
program  requirements  in  the  FY  78-83  period.  While  this  effort  is 
concentrated  on  training  requirements  within  USAFAS,  the  results  have 
Army-wide  application.  The  immediate  objectives  for  this  phase  of  the 
effort  were  to:  (1)  identify  Army  training  doctrine  and  developments 
affecting  resource  selection  and  utilization  during  FY  78-83;  (2) 
identify  USAFAS  training  support  situations  for  FY  78-83;  (3)  design  a 
preliminary  delivery  systems  selection  model;  (4)  identify  delivery 
systems  available  or  potentially  available  to  USAFAS;  (5)  provide  a plan 
for  export  and  evaluation  of  USAFAS-produced  computer-assisted  instruction 
lessons . 


Major  Findings. 

Detailed  rationale,  implications,  and  interpretation  for  findings  are  in 
the  text  and  Appendices. 

1.  A need  exists  for:  (1)  closer  attention  to  the  character- 
istics of  soldiers;  (2)  increased  realism  of  delivery  system  components; 

(3)  selection  of  techniques  less  demanding  of  resources;  and  (4) 
choice  of  training  delivery  systems  more  closely  integrated  with  systems 
for  job  and  mission  evaluation. 

2.  Life-cycle  management  should  integrate  system  design  with:  (1) 
man-machine  interface;  (2)  personnel  selection  or  job  assignment  criteria; 
and  (3)  EPMS/OPMS  specialty  and  skill  level  structure. 

3.  The  number  of  training  and  delivery  systems  potentially  useful 
through  FY  78-83  suggests  that:  (1)  exportability  be  broadened  to 
include  training  delivery  systems  that  can  be  embedded  in  a fielded 
weapons  system  or  can  be  accessed  from  remote  sites;  (2)  data  files  be 
established  that  contain  characteristics,  operational  status,  accessibility, 
and  constraints  of  training  delivery  systems. 


4.  TPADOC  goals  with  respect  to  responsibilities,  itianpov/er  utiliz- 
ation, and  fiscal  just  if icat ions  suggest  the  necessity  to:  (1) 

ensure  that  course  designers/developers  possess  the  skills  for  selecting, 
developing,  and  updating  media  and  courseware  for  a variety  of  alternative 
delivery  systems;  (2)  ensure  that  school  system  managers,  technical 
directors,  and  resource  managers  can  specify  procurement  requirements  as 
well  as  monitor  and  evaluate  contractor  plans  and  products;  and  (3) 
collect  and  summarize  data  on  cost  and  training  effectiveness  to  include 
user  acceptance,  throughout  the  life-cycle  development  of  a system. 

5.  Delivery  system  selection  factors.  Constraining  factors  and 
solution  factors  were  analyzed  against  five  developmental  requirements 
predicted  for  USAFAS  IN  FY  78-83: 

(1)  ITDT  Coverage  of  New  or  Developmental  System. 

(2)  ITDT  Retrofit  to  Fielded  System. 

(3)  Self-Pacing  of  MOS  Course  for  Export. 

(4)  Self-Pacing  of  MOS  Course  for  School. 

(5)  Update  of  Fielded  ITDT/MOS  Materials. 

Implications  from  this  analysis  include:  (1)  Developmental 
requirements  differ  enough  so  that  no  narrow  model  dealing  solely 
with  trainee,  subject  matter,  and  media  variables  at  one  decision  stage 
will  serve  the  five  situations:  (2)  The  model  should  integrate  the 
selection  of  delivery  systems  for  MOS-oriented  material,  combat  litera- 
ture, training  literature,  job-support  materials,  training  support 
materials,  and  evaluation  materials  to  maximize  compatibility  and 
minimize  the  potential  for  massive  updates.  (3)  There  are  significant 
differences  among  delivery  systems  in  terms  of  the  efficiency  and  ' 
resource  demands  in  updating  of  materials. 

6.  The  four  consecutive  decision  stages  of  a preliminary  delivery 
system's  decision  model  are:  (1)  State  delivery  system  requirements 
and  preliminary  candidates;  (2)  Select  major  delivery  systems  mix  for 
training  program;  (3)  Select  delivery  systems  for  specific  performance 
modules  and  lessons;  and  (4)  Assign  alternative  delivery  systems  during 
training  implementation.  Each  decision  stage  is  designed  to  produce 
decision  data  input  to  an  evolving  Individual-Collective  Training  and 
Evaluation  Plan  (ICTEP)  providing  a technical  development  and  resources 
management  baseline  throughout  the  entire  proponency  program. 

7.  An  inventory  of  the  specific  delivery  system  resources  existing 
or  potentially  available  for  field  artillery  training  in  FY  78-83 
indicates;  (1)  A data  file  should  be  established  of  attributes  relating 
to  the  interaction  of  delivery  system  capabilities  with  characteristics 
of  trainee,  subject-matter,  and  training  setting.  (2)  This  data  file 
should  be  usable  within  procedural  guidelines  to  be  developed  for  the 
four  decision  stages  of  the  preliminary  delivery  system's  selection 
model . 
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8.  Continued  development  of  the  TEC  Media  Selection  methodology  and 
frame  of  reference  is  suggested: 


(1)  Step  1 - USAFAS/ARI  Review,  Revisions  and  Concurrence  on  Approach 

(2)  Step  2 - Develop  Delivery  System's  Selection  Procedures 

(3)  Step  3 - Pilot  Implementation  and  Formative  Evaluation  at  USAFAS. 


9.  It  is  feasible  to  export  USAFAS-produced  CAI  lessons  to  Army 
units  via  telecommunications  access  from  the  unit  to  a central  computer 
source.  Requirements  include:  (1)  physical,  computer,  and  courseware 
resources;  (2)  procedures  guide  and  daily  usage  procedure;  (3)  student 
selection;  (A)  monitor  duties;  (5)  use  of  automated  and  manual  records; 
and  (6)  evaluation  guidelines.  Procedures,  examples,  and  specific  forms 
have  been  provided  in  this  report. 
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SECTION  1.  INTRODUCTION 


A.  BACKGROUND 

The  overall  purpose  of  the  TEC  Media  applied  research  program  is  to  determine 
effective  and  efficient  means  of  providing  exportable  training  packages  to 
field  force  units.  The  Army  recognizes  for  planning  that  TEC  Extension 
Training  Materials  (ETM)  could  employ  a full  range  of  alternative  delivery 
systems  for  individual  and  collective  performance  training  in  units.  Indeed, 
the  current  emphasis  on  a first-battle-win  readiness  posture  demands  realism 
of  situation  and  active  responses  in  the  training  of  field  forces.  The  variety 
and  levels  of  system,  job,  and  mission  performance  requirements  within  Field 
Artillery  units  and  among  the  combat  arms  branches  requires  training  and 
evaluation  techniques  which  are  flexible  to  unit  training  and  work  settings, 
realistic  in  terms  of  presentation  and  active  practice  capabilities,  yet  less 
costly  than  traditional  techniques  in  resources  consumption  (ammo,  fuel,  time, 
and  training  support).  This  broad  outlook  is  evident  by  methods  suggested  in 
FM  21-6  for  conducting  performance-oriented  unit  training  and  in  TC  21-5-7  on 
unit  training  management.  It  is  also  evident  in  the  innovative  delivery 
systems  being  designed,  assessed,  and  implemented  by  various  DA  agencies  and 
service  schools.  These  include  computer-mediated  training  support;  simulation 
devices  for  training  and  evaluation  in  marksmanship/gunnery  and  fire  direction; 
tactical  games,  command  staff  simulation  exercises,  and  two-sided  engagement 
simulations . 

Despite  these  innovative  trends,  with  a few  exceptions,  past  and  continuing 
practice  sees  TEC  exportable  training  wedded  to  a narrow  range  of  delivery 
systems — audiovisual  filmstrips  for  the  Beseler  Cue-See,  printed  materials, 
and  audio-directed  practice  cassettes  for  use  in  fixed  or  portable  tape 
players.  This  narrow  focus  perpetuates  itself  due  in  part  to  early  decisions 
to  procure  and  distribute  large  numbers  of  a few  media  devices,  pressures 
upon  service  schools  to  convert  a range  of  MOS  course  objectives  to  formats 


i 
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of  these  devices,  available  production  capabilities  of  competing  contractors, 
increased  service  school  capabilities  to  develop  materials  in  these  formats, 
short  lead-time  decisions  causing  choices  within  the  available  and  predictable 
options,  and  a consequent  tendency  to  formalize  and  limit  the  meaning  of 
"exportable"  training  in  terms  of  the  three  familiar  TEC  "tracks". 

The  traditional  TEC  approaches  do  offer  considerable  flexibility  for  individual 
and  small-group  use  in  certain  unit  training  settings.  The  audiovisual-print- 
audio  practice  options  can  be  designed  to  include  realistic  practice  for 
certain  kinds  of  job  tasks  in  certain  settings.  Army  studies  have  also 
obtained  evidence  supporting  the  efficiency  and  effectiveness  of  TEC  training.  ^ 
A mix  of  TEC  media  (e.g.,  audiovisual,  printed  worksheets)  can  be  selected 
for  the  sensory  modalities  and  symbolic  or  actual  responses  most  natural  to 
the  job  cue-response  situations.  Another  approach,  more  useful  in  an  institu- 
tional self-paced  course  or  in  an  individual  learning  center,  is  to  make 
alternative  versions  of  candidate  subject-matter  modules  available  in  different 
media.  Presumably,  given  the  option  to  choose,  each  trainee  would  choose  that 
option  closest  to  his  preferred  cognitive-perceptual  style;  e.g.,  seeing, 
hearing,  reading,  doing.  Carried  a step  farther,  given  valid  and  reliable 
individual  difference  indices  of  cognitive-perceptual  style  available  from 
soldier's  records  or  simple  instruments  easily  administered  as  part  of  the 
training  management  plan,  then  a soldier  or  group  of  soldiers  could  be 
assigned  a mix  of  alternatives  appropriate  to  the  profile  shown. 


There  is  little  sense  in  considering  alternative  delivery  systems  unless  there  ^ 

is  evidence  of  the  feasibility  and  utility  of  their  employment  in  Army  training  | 

and  training  development  settings.  Specifically,  there  should  be  evidence  ' | 

that:  I 

i 

• course  developers  in  proponent  service  schools  can  develop  course-  j 

ware  for  the  delivery  system,  and  can  specify  and  monitor  the  design  I 

i 

and  development  requirements  If  contracted-out  y 


• the  training  and  training  management  capability  is  exportable  to  or 
accessible  from  unit  training  settings 

• the  training  is  effective,  efficient,  and  acceptable  for  unit 
trainees  and  job  training  supervisors 

Prior  tasks  of  the  current  work  have  looked  at  one  sophisticated  alternative 
delivery  system  for  TEC — Computer  Assisted  Instruction  (CAI) . Results, 
reported  in  the  companion  volume  to  this  report  (TM-5841/000/00)  suggest 
that  CAI  is  a useful  alternative  in  training  Field  Artillery  personnel.  More- 
over, USAFAS  course  developers  successfully  converted  audiovisual  TEC  lessons 
to  CAI  lessons  with  the  same  training  objectives,  input  lessons  from  a school 
terminal  tied  to  a remote  Army  service  bureau  computer,  conducted  a pre- 
liminary evaluation  of  the  CAI  lessons  consisting  of  on-line  review  by  subject 
experts  and  lesson  tryouts  with  novice  Army  students,  then  used  the  CAI 
system  to  make  immediate  changes  to  lessons  as  indicated  by  the  formative 
evaluations.  Computer  costs,  course  developer  man-hours,  and  elapsed  time 
were  within  expectations.  Subject  expert  and  student  reaction  to  the  CAI 
lessons  was  excellent.  USAFAS  is  now  capable  of  developing  their  own  CAI 
lessons,  checking  them,  and  validating  them  on-computer.  CAI  work-projects  at 
the  school  are  continuing.  Other  ARI-sponsored  work  has  established  the 
feasibility  of  using  tactical  system  computers  in  a CAI  delivery  system  mode 
when  they  are  not  in  operational  use.  The  CAI  training  of  MOS-related 
infantryman  skills  was  demonstrated  with  positive  results  using  a tactical 
system  (DEVTOS)  at  Ft.  Hood  MASSTER  facility.  The  feasibility  of  using  CAI 
as  a training  vehicle  for  TACFIRE  system  operators  was  initially  demonstrated 
at  USAFAS,  and  evaluation  and  planned  extensions  of  capability  continue. 

Similarly,  in  the  area  of  simulation  training,  USAFAS  is  assessing  the  utility 
and  feasibility  for  export  of  an  Observed  Fire  panoramic  classroom  simulator 
which  permits  display  realism  and  selection  under  control  of  an  operator 
panel,  and  allows  classroom  participants  to  spot  bursts  and  determine  effects. 


1-4 

Also,  two  Army  engagement  simulation  systems  have  been  developed  and  their 

implementation  in  the  Army  is  nearing  completion.  SCOPES  was  implemented 

Army-wide  by  USAIS  in  1974.  ARI  subsequently  expanded  SCOPES  into  the  REALTRAIN 

system  which  added  the  capability  to  employ  artillery  support,  mines,  tanks, 

and  anti-tank  weapons  during  two-sided  platoon  level  exercises . TRADOC  and 

ARI  recently  concluded  a joint  effort  with  USAREUR  to  implement  REALTRAIN  in 

2 

the  divisions  in  Europe.  Results  and  acceptance  were  excellent. 
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In  sum,  delivery  system  options  are  plentiful  given  a broader  outlook  on 
exportability,  including  devices  and  simulation  packages  delivered  with  an 
Army  system  or  MOS  training  program,  capabilities  embedded  into  the  system  or 
job-setting,  and  telecommunications  access  to  delivery  systems  remote  from  the 
unit  location.  The  primary  problem  is  a workable  plan  for  matching  delivery 
systems  methods  and  media  with  soldier  characteristics  and  subject-matter 
characteristics  within  constraints  and  capabilities  of  a given  instructional 
situation. 

B.  PURPOSE  OF  THIS  PLANNING  TASK 

In  the  selection  of  delivery  systems  method  and  media  mix  oriented  to  the 
individual  and  collective  training  and  evaluation  needs  of  Field  Artillery 
soldiers,  jobs,  systems,  and  missions,  there  is  a strong  interaction  between 
constraints  and  solutions.  Alternative  delivery  systems  should  be  viewed  as 
complementary  rather  than  competitive  on  a number  of  factors,  such  as:  (1) 
types  and  levels  of  individual-collective  competencies  in  the  overall  training 
program  and  any  given  performance  module;  (2)  characteristics  or  preferences 
of  the  soldier  trainee  population;  (3)  delivery  system  options  for  presenta- 
tion, active  response,  practice,  feedback,  and  control  of  the  training 
sequence. 

^cf.  RPR  75-3,  "A  Cost  Assessment  of  Army  Training  Alternatives",  ARI,  Aug  1975. 
RR  1188,  "Training  Individuals  in  Army  Units:  Comparative  Effectiveness  of 
Selected  TEC  Lessons  and  Conventional  Methods",  ARI,  Dec  1975. 

2 

Gorman,  MG  Paul p . "Engagement  Simulation".  Proceedings  of  SALT/NSIA 
Sjnnposium  (Volume  IV),  Wash.,  D.C.,  22-24  July  1976,  pgs . 136-144. 
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On  the  other  hand,  alternative  delivery  systems  are  competitive  in  terms 
of  actual  or  potential  constraints  of  any  given  training  situation.  Con- 
straints of  a training  or  training  development  situation  may  include:  (1) 
options  permitted  within  DA/TRADOC  regulatory  directives  or  specifications; 

(2)  characteristics  and  limitations  of  the  work-training  setting;  (3)  require- 
ments for  exportable  packaging,  access,  or  field  utilization;  (4)  demands 
upon  trainees  or  training  supervisors  in  field  or  school;  (5)  special  skills 
required  for  courseware  development  or  update;  (6)  inherent  recordkeeping 
capabilities  of  the  delivery  system;  (7)  efficiency  of  methods  for  updating 
existing  courseware;  and  (8)  relative  costs  of  acquisition,  operation,  main- 
tenance, and  courseware  development. 

In  view  of  the  many  complementary  and  competitive  delivery  system  selection 
factors,  the  goals  of  this  work  are  both  immediate  and  long-range.  The 
longer-range  goal  is  to  develop  practical  data  sources,  decision  procedures, 
and  resources  management  approach  that  will  permit  USAFAS  training  managers 
to  select  an  optimum  delivery  system  design  mix  for  any  major  individual- 
collective  training  and  evaluation  program  requirement  arising  in  the  FY  78-83 
period.  In  view  of  this  goal,  the  immediate  goals  of  this  planning  task 
are  to: 

• get  a realistic  fix  on  the  probable  types  of  training  development 
requirements  USAFAS  will  mount  in  the  FY  78-83  period,  and  the  DA 
regulatory  and  doctrinal  initiatives  within  which  these  training 
developments  must  operate 

• given  this  framework,  to  design  a compatible  delivery  systems 
selection  process  and  identify  decision  steps,  types  of  decisions, 
source  data,  and  guidance. 
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• provide  a workplan  for  followup  review,  detailing,  pilot  imple- 
mentation, and  development  of  these  procedures  with  USAFAS  and  ARI 

• provide  a plan  for  exporting  the  CAI/TEC  package  developed  by 
USAFAS  to  a Field  Artillery  unit  and  methods  for  evaluating  the 
package  in  the  unit  setting. 

C.  ASSUMPTIONS 

Assumptions  both  guiding  and  emerging  from  the  objectives  and  approach  to  the 
initial  planning  work  reported  herein  are  as  follows: 

1.  The  present  work  should  provide  a realistic  frame  of  reference  for  TEC 
concept  planning  in  the  proximal  future,  FY  78-83.  This  should  receive 
major  emphasis. 

2.  As  a part  of  problem  definition  it  is  essential  to  Identify  Army 
regulatory  and  doctrinal  changes  that  will  impact  delivery  systems 
selection  and  support  decisions  at  USAFAS  in  the  FY  78-83  period. 

3.  As  a part  of  problem  definition  it  is  essential  to  predict  different 
course  design  and  development  situations  facing  USAFAS  training  and 
resource  managers  in  the  FY  78-83  period,  and  to  summarize  how  these 
situations  impact  delivery  system  solutions  and  constraints. 

4.  Decisions  on  the  most  appropriate  delivery  system  or  systems  for  a 
training  program  must  take  into  account  a number  of  factors,  including: 
(1)  nature  of  the  work-training  setting(s);  (2)  characteristics  of 

the  subject  matter;  (3)  readily  available  characteristics  of  trainees; 

(4)  available  or  potentially  available  school  and  unit  training 
resources;  (5)  utility  to  USAFAS  training  supervisors  and  field 
artillery  unit  job-training  supervisors;  (6)  constraints — cost,  leadtime, 
facilities,  developer  capability  and  availability,  and  the  applicable 
Army  regulatory  directives  and  specifications. 
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5.  Optimal  delivery  system  decisions  should  be  based  on  an  integrated 
plan  for  individual-collective  training  and  evaluation  requirements. 

This  can  be  the  outcome  of  successive  decision  stages  keyed  to  life- 
cycle  phases  of  a system  or  specialty  training  support  program. 

Decisions  should  be  based  upon  the  appropriate  priorities  and  types  of 
data  available  in  each  phase;  rather  than  comt)lex  analyses  attempting 
to  deal  with  all  variables  mechanistically  at  once,  or  narrow  data  on 
only  a few  variables. 

6.  Results  of  this  work  should  allow  creation  of  a decision  plan  and  pro- 
cedures for  media  selection  based  on  desired  behavioral  changes,  and 
which  can  be  evaluated  by  mission/ job  performance  and  attitudinal 
measures,  as  well  as  relative  cost-utility  indices. 

D.  TASK  OBJECTIVES 

The  immediate  objectives  of  the  current  planning  task  are  to: 

1.  Identify  the  DA/TRADOC  regulatory  initiatives  and  delivery  system 
initiatives  underway  having  implications  for  USAFAS  and  Field  Artillery 
training  and  evaluation  resources  utilization  in  the  FY  78-83  period. 

2.  Identify  selection,  solution,  and  constraint  factors  influencing 
delivery  system  decisions.  Determine  types  of  training  development 
situations  predicted  to  impact  USAFAS  during  FY  78-83  and  contrast 
these  on  the  delivery  system  selection,  solution,  and  constraint  factors. 

3.  Determine  a rational  set  of  delivery  system  decision  stages  within 
activities  and  events  of  a system-job  and  specialty  life-cycle 
proponency  management  model.  Describe  the  selection  factors,  decisions, 
and  types  of  data  appropriate  to  each  stage.  Determine  the  need  for  an 
individual-collective  training  and  evaluation  plan  to  make  decisions 
visible,  focus  development  on  an  integrated  set  of  requirements,  and 
provide  rationale  for  resource  demands. 
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4.  Identify  types  and  specific  examples  of  delivery  systems  for  individual- 
collective  training  and  evaluation  which  will  be  available  or  are 
potentially  available  to  field  artillery  units  and/or  USAFAS  during 

FY  78-83,  either  from  USAFAS  or  other  TRADOC/DA  sources. 

5.  Provide  a plan  for  reviewing,  developing,  and  evaluating  with  USAFAS 
and  -YRI  the  preliminary  delivery  systems  decision  and  management 
control  model  presented  in  this  report. 

6.  Provide  a plan  for  the  export  of  USAFAS-produced  CAI  to  a FORSCOM  unit, 
and  for  the  evaluation  of  CAI  training  in  the  unit  setting. 

The  objectives  for  subsequent  work  phases  are  to: 

1.  Obtain  USAFAS/ARI  concurrence  and  revisions  to  the  frame  of  reference 
and  preliminary  delivery  systems  decision  plan  contained  in  this  report. 

2.  Further  detail  and  develop  the  delivery  systems  selection  procedures, 
define  data  sources,  and  specify  products  which  incorporate  Army 
priorities. 

3.  Pilot  test  the  application  of  the  delivery  systems  selection  procedures 
in  an  appropriate  training  program  development  activity  at  USAFAS; 
gather  data,  evaluate  the  procedure,  and  revise  components  in  accord 
with  findings. 

E.  SCOPE  AND  APPROACH  OF  CURRENT  TASK 

The  approach  to  this  planning  task  supported  the  objectives  and  assumptions. 

Collect  and  Review  Information.  During  a visit  to  USAFAS  in  August  1976, 

SDC  personnel  discussed  priorities  for  this  task  with  Training  Development  and 
Course  Development  managers,  observed  specific  delivery  systems  in  use  for 
training  and  evaluation  of  fire  detectlon/directicn  and  command-post  exercises, 
and  obtained  references  on  specific  methods  and  devices.  During  the  TEC-CAI 
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conversion  period  at  USAFAS  in  March  1977,  discussed  with  Course  Design, 

Course  Development,  and  Training  Development  supervisors  delivery  svstems 
selection  decisions,  hand-offs,  and  problems  as  experienced  by  USAFAS;  obtained 
and  reviewed  regulatory  and  guidance  documentation.  In  April  1977,  at  TDI,* 
discussed  and  reviewed  a number  of  recent  TRADOC  initiatives  and  doctrinal 
changes  in  areas  of  joint  TRADOC/DARCOM  total  systems  management,  service 
school  life-cycle  proponency  as  user  representative  of  field  forces,  integra- 
tion of  technical  documentation  and  training  (ITDT)  specifications;  responsi- 
bilities and  roles  of  service  schools,  the  TRADOC  System  Managers,  and  other 
TRADOC  groups;  and  delivery  system  innovations  being  assessed  for  future 
applications . 

Identify  Army  Training  Doctrine  and  Developments  Impacting  Training  Resource 
Selection  and  Utilization  FY  78-83.  In  May  1977,  information  from  USAFAS, 

TDI,  and  SDC  was  reviewed  to  define  major  development  situations  applicable  to 
USAFAS  during  FY  78-83,  and  to  summarize  impacts  on  delivery  system  constraints 
and  available  solutions. 

Design  Preliminary  Delivery  Systems  Selection  Model.  During  April  and  May,  in- 
formation from  the  above  two  problem  definition  steps  was  synthesized  into 
four  delivery  system  decision  stages,  compatible  with  events  and  technical- 
management  products  of  a total  system  and  MOS  life-cycle  proponency  management 
model.  Decision  factors  and  decision  data  appropriate  to  each  stage  were 
identified,  and  the  decision  described. 

c 

Identify  Delivery  Systems  for  USAFAS/Field  Artillery  Individual-Collective 
Training  and  Evaluation.  Information  on  training  and  evaluation  resources 
collected  in  the  earlier  steps  was  summarized  as  to  availability  and 
capabilities,  providing  a database  for  future  analysis  and  expansion. 


*The  Training  Developments  Institute  of  Army  Training  Support  Center,  TRADOC. 
Formerly  named  TMI  (Training  Management  Institute). 
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Provide  a Plan  for  Further  Development  and  Evaluation.  A continuing  three- 
step  workplan  was  defined  to  permit  review,  revision,  detailing,  applying,  and 
evaluating  the  preliminary  delivery  systems  selection  framework  set  forth 
in  this  report- 

Provide  a Plan  for  Export  and  Evaluation  of  CAI  in  a FORSCOM  Unit.  A plan  was 
generated  containing  requirements  for  exporting  and  evaluating  USAFAS-produced 
CAI  in  an  Army  field  unit  setting  (Ft.  Hood). 


F.  ORGANIZATION  OF  REPORT 


Executive  Summary 


• Section  1 - provides  the  background,  purpose,  assumptions,  objectives, 
and  approach  for  the  current  and  longer-range  goals. 


• Section  2 - summarizes  a number  of  DA  regulatory  and  doctrinal 
initiatives,  as  well  as  resource  development  trends,  to  suggest 
the  external  context  within  which  USAFAS  delivery  systems  decisions 
will  be  made  during  FY  78-83. 


• Section  3 - identifies  primary  selection,  solution,  and  constraint 
factors  influencing  delivery  system  decisions.  Postulates  five 
training  program  development  situations  predicted  to  impact  USAFAS 
during  FY  78-83  and  contrasts  each  situation  with  respect  to  the 
decision  factors. 


• Section  4 - depicts  a rational  delivery  systems  selection  process 
as  a related  series  of  decisions  based  upon  the  activities,  available 
data,  and  interim  products  for  each  phase  of  an  overall  system  and 
MOS  life-cycle  management  model.  Summarizes  the  types  of  delivery 
system  decisions  and  decision  data  appropriate  to  each  stage. 
Highlights  the  importance  of  evolving  a baseline  Individual- 
Collective  Training  and  Evaluation  Plan  (ICTEP)  as  a basis  for 
Integrated  management  of  technical  developments. 
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• Section  5 - identifies  generic  specific  delivery  systems  for 
training  and  evaluation  as  available  or  potentially  available  to 
field  units  and/or  USAFAS  in  FY  78-83.  Summarizes  capabilities  and 
constraints. 

V 

e Section  6 - pr#/ldes  a plan  for  exporting  CAI  as  a turnkey  operation 
from  USAFA^  to  an  Army  unit  and  for  evaluating  CAI  packages  in  the 
♦ unit  setting. 

® Section  7 - summarizes  conclusions  and  recommendations. 

• Appendices  - provide  examples,  abbreviations,  and  references. 
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SECTION  2.  TRAINING  AND  EVALUATION  RESOURCES  UTILIZATION  CONTEXT  FY  78-83 

Part  of  the  problem  facing  USAFAS  in  the  FY  78-83  period  is  the  rapid  evolu- 
tion of  Da  trends  and  doctrine  in  the  acquisition  of  systems,  integrating 
combat  developer  and  training  developer  inputs  during  system  acquisition, 
changing  responsibilities  among  TRADOC  organizations,  interfaces  with  field 
forces  and  procuring  commands,  and  the  multitude  of  delivery  system  options 
t either  available  for  individual-collective  training  and  evaluation  or  in 

various  stages  of  development  by  DA  groups  (service  schools,  ARI,  ATSC,  PM 
ARTADS,  PM  TRADE/TRADER,  etc.)-  The  purpose  of  this  section  is  to  summarize 
a number  of  DA  trends  and  initiatives  to  provide  the  context  within  which 
USAFAS/Field  Artillery  unit  training  resource  selection,  design,  and  utiliza- 
tion decisions  will  be  made  in  the  FY  78-83  period. 

A.  FIRST-BATTLE-WIN  READINESS 

The  1973  Arab/Israeli  war  has  greatly  impacted  on  the  way  the  Army  intends  to 
fight  the  next  war.  The  lethality  of  modern  weapons  dictates  a briefer,  more 
violent  warfare  than  ever  before.  Once  hostilities  begin,  there  will  be 
little  time  to  prepare  for  combat.  To  attain  battle  success,  the  Army  is 
striving  to  field  the  best  possible  weapons,  tactics  and  techniques,  and 
soldiers  trained  to  employ  them.  A number  of  system  test  cases  (e.g. , LAW, 

TOW,  DRAGON,  tanks)  attest  to  system  performance  gaps  between  the  designed, 
expected  performance  of  a system  and  the  actual  operational  effectiveness  of 
a current  system  manned  by  its  soldier  users.  This  shortfall  in  weapons 
capability  represents  a loss  of  the  resources  invested  in  the  weapon  system. 

To  ensure  being  ready  to  win  in  advance,  Army  units  must  in  peacetime  acquire 
and  sustain  a high  degree  of  job  proficiency  and  combat  readiness  in  applying 
and  maintaining  their  systems.  Ways  must  be  found  to  make  more  effective  and 
efficient  use  of  training  time  and  work-training  settings  in  order  to  achieve 
I the  goal  of  sustained  weapons  system  and  job  proficiency.  In  the  past.  Army 

( unit  training  and  evaluation  has  relied  upon  use  of  operational  equipment,  live 
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fire  exercises,  and  large  tactical  maneuvers  in  the  field.  Dramatic  rises  in 
costs  of  ammo,  fuel,  spare  parts,  and  new  materiel  combined  with  maneuver  area 
restrictions  due  to  weapons  lethality  have  curtailed  this  type  of  training. 
Realism  is  also  a problem.  Live  fire  exercises  permit  realism  in  maneuvers, 
but  no  troops  shoot  back.  Tactical  field  exercises  use  opposing  forces,  but 
not  live  ammo. 


In  sum,  to  optimize  battlefield  effectiveness  by  improving  individual  and  unit  ^ 

proficiency.  The  Army  during  FY  78-83  will  seek  training  delivery  and  support  j 

systems  which:  (1)  allow  high  fidelity  simulation  of  modern  weapons  and 
modern  battlefield  environments;  (2)  are  less  constrained  by  safety  and  less 

demanding  of  operational  resources  (ammo,  fuel,  parts,  range-training  areas);  i 

i 

and  (3)  allow  unit  commanders  to  more  effectively  utilize  time  and  personnel 
available  for  training. 


t 
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B.  INCREASED  NUllBERS,  AUTOMATION  AND  COMPLEXITY  OF  SYSTEMS 


I 

Forty-four  major  systems  will  enter  the  Army  inventory  between  FY  77  and  FY  85.  < 
Included  in  this  timetable  through  FY  81  are  USAFAS  combat  and  training  i 
proponency  for  fielding  TACFIRE  and  Battery  Computer  System  (BCS)  with  ECOM  ; 
(FY  76-77),  the  XM-204  with  ARMCOM  (FY  78),  SP  ARTY  M107/110/109/109A  Total  \ 
System  with  ARMCOM  and  TARCOM  (FY  79),  and  Towed  ARTY  with  ARMCOM  (FY  81).  1 


Artillery  sensors,  weaponry,  guidance,  communications,  and  tactical  command- 
control  systems  at  all  levels  of  field  organization  from  the  Forward  Observers 
through  DivArty  Fire  Direction  Centers  are  employing  advanced  technology  with 
evolutionary  plans  for  increasing  levels  of  autcmation,  miniaturization,  system 
compatibility  among  echelons,  and  interoperability  with  joint-force  systems 
such  as  TAC  and  German  Artillery.  Examples  of  battlefield  subsystems  include 
a variety  of  implanted  and  mobile  sensors,  laser  sensors  and  direction- 
finders, laser-guided  and  heat  seeking  weapons,  portable  digital  coirimunication 
and  graphic  display  devices,  and  computer-based  information  processing  at 


i 
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Bn  FDC/DivArty  FDC  levels  which  permit  information  access  from  fire  support 
elements.  Virtually  every  new  weapons  system  fielded  in  the  future  will  include 
microprocessors  and  automated  test  gear  to  semi-autoraate  operational  and  main- 
tenance functions.  This  increased  automation  will  continue  during  the 
FY  78-83  period  to  impact  technical  and  tactical  warfare  doctrine,  system  and 
mission  performance  standards,  and  the  training  requirements  for  those 
individual  soldiers  or  teams  who  must  employ  and  maiatain  Army  systems. 

With  sufficient  foresight,  much  of  the  automation  planned  for  operational 
functions  can  also  be  adapted  to  support  the  training,  practice,  and  evaluation 
needed  to  acquire  and  sustain  proficiency  in  systems  use  or  maintenance. 

Recent  applications  of  Army  tactical  computers  at  Ft.  Hood  and  at  USAFAS 
(TACFIRE)  are  demonstrating  how  operational  Army  computers  and  communications 
devices  can  be  adapted  to  support  system  user  training  or  MOS-related  refresher 
training  during  periods  when  operations  functions  are  of  secondary  importance. 
Similarly,  a series  of  truck,  tank  and  heavy  engineer  equipment  simulators 
are  being  developed  to  simulate  equipment  functions  and  serve  as  substitutes’ 
for  actual  equipment.  A family  of  full  crew  Interactive  simulators  is  pro-* 
jected  for  fielding  with  the  new  battle  tank  (XM-1)  and  the  Mechanized  Infantry 
Combat  Vehicle  with  TOW  Bushmaster  .Armored  Turret  (MICV-TBAT) . The  trend  to 
build  into  Army  systems  the  capability  to  support  the  training  and  evaluation 
of  user-maintenance  teams  once  the  system  is  fielded — called  Embedded  Training 
(ET) — can  be  expected  to  continue  in  the  FY  78-83  period.  This  is  because: 

(1)  it  is  realistic  to  train  users  at  their  job  duty  positions  and  devices; 
and  (2)  the  primary  equipment  costs  and  certain  software  costs  for  training 
support  may  already  be  invested  in  acquiring  the  operational  system. 

C.  SOLDIER  CHARACTERISTICS,  TURBULENCE,  AND  RETENTION 

The  military  manpower  is  now  costing  more  than  50  percent  of  the  defense 
budget.  Some  of  this  expense  is  in  high  training  costs,  due  in  part  to  the 
complexity  of  modern  weapons  mentioned  above,  but  a principal  cost  is  due  to 
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rapid  turnover.  In  today's  Army  an  annual  50  percent  turnover  rate  or  3 to  6 
months  In  a duty  assignment  is  not  unusual.  Less  than  15  percent  of  the 
enlisted  ranks  are  reenlisting,  perhaps  due  to  what  they  see  as  a real  or 
potential  diminishing  value  of  the  military  career — fringe  benefits,  permanence, 
retention  of  awarded  grades  until  retirement,  and  retirement  benefits.  Officer 
end-'itrength  retention  is  also  showing  a problem  trend  between  1976  and  1977; 
for  example,  among  Captains  with  an  average  of  8 years  of  service.  A recent 
congressional  study  notes  that  the  Army  and  Marines  are  falling  short  in 
recruiting  and  reserve  forces  are  greatly  understrength  under  the  all-volunteer 
military  force.  Reasoning  for  the  dramatic  increase  of  ethnic  minorities  in 
the  Army  ranges  from  the  increasing  number  who  are  mentally  and  physically 
qualified  to  an  "economic  conscription"  caused  by  the  near-double  civilian 
unemployment  rate  of  minority  males.  The  net  effect  of  all  this  is  a continual 
entry-level  or  retraining  load  and  management  burden  of  large  magnitude  for 
Army  schools  and  units. 


Solutions  are  not  straightforward.  Existing  trends,  and  alternatives  under 
consideration,  portend  any  of  the  following  for  the  FY  78-83  period:  (1) 
revised  policies  on  conscription;  (2)  revised  recruiting  and  job  assignment 
policies;  (3)  use  of  more  women  in  non-combat  jobs;  (4)  tighter  initial 
screening  to  reduce  turnover;  (5)  closer  examination  of  educational  and  aptitude 
standards  actually  required  for  service  jobs;  (6)  changes  in  job  rotation 
practices  to  favor  job  competence;  (7)  job  design  as  part  of  fielded  system 
and  unit  organizational  design;  (8)  MOS  revisions,  or  specialty  shred-outs  more 
closely  related  to  actual  unit  jobs;  (9)  greater  focus  on  the  soldier's  job 
competence  as  the  basis  for  career  progress;  and  XlO)  work-training  programs 
as  the  preferred  and  primary  Army  instructional  Situation. 

Within  these  larger  solutions,  the  implications  for  a training  delivery  systems 

; 

selection  model  appear  to  be  as  follows:  / 
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! • Close  attention  to  job  design,  including  MOS  conbinations  or 

specialty  shred-outs,  early  in  a system  or  MOS  proponency  program 
j based  upon  the  anticipated  density  and  abilities  of  the  personnel 

subsystem  pool. 

I • Priority  to  training  settings  and  delivery  systems  which  are 

clearly  job-related  and  allow  realistic  cues  and  responses. 

‘ • Priority  to  soldier  self-pacing  for  mastery  of  individual  skills. 

• Consider  requirements  for  skills  acquisition,  evaluation,  and 
sustaining  practice  in  selecting  a delivery  systems  mix. 

• Provide  alternative  delivery  systems  for  the  same  objectives,  where 
feasible  and  warranted  by  training  density. 

• Simplify  the  combined  pictorial-verbal  intelligibility  and  com- 
prehension burden  on  trainees  by  appropriate  media  selection  and 
care  in  materials  development.  Ensure  that  validation  and  user 
testing  confirms  intelligibility  and  comprehension. 

D.  TOTAL  SYSTEM  MANAGEMENT 

In  the  Army  system  acquisition  process,  the  personnel  subsystem,  logistics 
( support,. and  training  support  has  traditionally  been  playing  catch-u?  with  the 

I materiel  system.  This  has  become  evident  numerous  times  in  operational  tests 

f that  compared  an  Army  system's  expected  performance  effectiv'eness  against  its 

^ actual  effectiveness  when  employed  by  unit  users,  typically  showing  a wide 

' performance  gap  (e.g.,  DRAGON,  tanks).  Schools  and  units  have  had  to  operate 

i under  a continual  "train-up"  priority  in  an  attempt  to  close  gaps. 

The  Total  Systems  initiative,  as  exemplified  by  AR  1000-2  ^23  December  1976 
draft)  says  that  training,  personnel,  and  logistics  support  subsystems  of  a 
total  Army  materiel  system  will  be  integrated  by  joint  TRADOC/D.ARCOM  effort 
■ with  the  acquisition  life-cycle  for  the  operations  and  maintenance  equipment 

, of  new  and  developmental  Army  systems.  The  general  concept,  interfaces,  and 


resources  impact  is  shown  in  Figure  2-1.  TRADOC  is  chartered  to  ensure  that  the 
training  and  personnel  subsystem  is  fielded  along  with  the  total  weapon  system  a 
OT-II.  Further,  TRADOC  combat  development  decisions  must  be  integrated  with 
training  development  decisions — an  important  difference  between  the  TRADOC 
approach  and  several  other  U.S.  and  foreign  training  commands.  The  goal  is  an 
integrated  logistics  support  package.  The  maintenance  burden  implications 
for  most  systems  will  include  automated  test  gear,  simplified  training,  and 
simplified  technical  manuals  and  job-aids. 

Table  2-1  shows  how  AR  1000-2  will  impact  the  association  of  training  develop- 
ment activities  with  parallel  system  acquisition  events  of  the  Life-Cycle 
System  Management  Model  (LCSMM) . One  goal  is  an  attempt  to  cut  the  lead-time 
for  fielding  and  total  life-cycle  system  costs.  The  impact  of  this  is  that 
the  old  Low-Rate  Initial  Production  (LRIP)  and  associated  DT/OT-III  LCSMM 
events  preceding  a production  decision  will  now  be  considered  non-essential 
and  will  not  be  conducted  unless  specifically  approved  by  ASARC.  The  burden 
is  now  shifted  to  earlier  operational  tests; 

"Operational  tests  will  be  conducted  in  a truly  tactical  environment, 
making  use  of  field  maintenance,  training,  manual-.,  countermeasures, 
etc.  A complete  integrated  logistic  support  package  and  training 
package  must  be  procured  early  enough  to  prepare  for  and  demonstrate 
during  DT/OT-II  the  adequacy  of  the  training  and  logistic  support 
packages."  (AR  1000-2  draft.) 

The  implication  of  this  for  job  support  packages  including  training  support 
materials  is  that  draft  synoptic  outlines  of  technical  manual  critical  task 
lists  and  preliminary  drafts  of  critical  task  sequences  must  be  available  for 
input  to  DT/OT-I.  The  validated  tech  manuals  and  training  support  package 
including  any  prototype  simulators  must  be  available  for  DT/OT-II  and 
related  government  composite  package  verification  tests. 


MAT  ACQ  PROCESS  OUTPUT 


Figure  2-1.  General  Impact  of  AR  1000-2  Draft  on  Total  Systems  Development 


Table  2-1. 


General  Relationship  of  Training  Activities  to  LCSMM  Basic  Events 


EVENT  *. 


t 

LCSMM  PHASES  AND  BASIC  EVENTS 

ASSOCIATED  TRAINING  ACTIVITIES 

REQITREMENT/CONCEPT  GENERATION 

1 

Materiel  Concept  Investigation 

• 

Materiel/Training  Trade-off  Analysis 

2 

LOA 

• 

Establish  Training  Concept 

8 

CFP 

• 

Identify  Study  Needs  (MOA) 

9 

ODP 

• 

Prepare  Outline  Training  Plan 

14 

Program  Initiation  Decision 

• 

Inputs  to  LCSMM  (LOA,  CFP,  etc.) 

VALIDATION  PHASE 

16 

Advanced  Development  Contract 

• 

Front-End  Analysis  and  Design  Contract 

21-22 

DT/OT  I 

• 

Perform  Front-End  Analysis 

31 

ROC/LR 

• 

Evaluate  Alternative  Designs 

33 

DP 

• 

Specify  Training  Device  Requirements  (TDR) 

37/42 

Full-Scale  Development  Decision 

• 

Prepare  Training  Plan 

J 

• 

Inputs  to  LCSMM  (ROC/LR,  DP,  etc.) 

1 

! FULL-SCALE  ENC'R  DEVELOPMENT  PHASE 

45 

Engineering  Development  Contract 

• 

Training  Development/Production  Contract 

51-52 

DT/OT  II 

• 

Develop  Materials/ Devices 

60 

Update  DP 

e 

Start  New  Equipment  Training 

64/71 

Prod,  and  Deployment  Declalon 

• 

Validate  Program  (OT  II) 

• 

Inputs  to  LCSMM  Basic  Events 

PRODUCTION  AND  DEPLOYMENT  PHASE 

72 

Production  Contract 

• 

Produce  Training  Materials/Devices 

78-79 

DT/OT  in  (If  authorized) 

• 

Field  Test  Program 

82 

Update  DP 

• 

Update  Training  Plan 

105 

IOC 

111 

Materiel  Objective  Achieved 

• 

Implement  Program  (Resident  and  Unit) 

117 

Reqt.  for  New  Materiel  Identified 

• 

Evaluate/Revise  Program 

118 

Type  Class  Contingency 

• 

Inputs  to  LCSMM  Basic  Events 

119 

Type  Clsss  Obsolete/Disposal 

• 

Phase-out 

Event  I refers  to  LOW  event  nunber  used  in  Army  I’smphlet  11-25  (dated  Hay  1975)  . 
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E.  INTEGRATED  TECHNICAL  DOCUMENTATION  AND  TRAINING  (ITDT)^ 

This  is  a recent  Army  process  and  product  initiative  designed  to  ensure  that 
technical  manuals,  job  aids,  and  training  for  system  operators  and  maintenance 
personnel  are  engineered  as  a total  job  support  package  for  delivery  to  user 
commands  with  the  fielded  materiel  system.  Performance  of  the  total  weapons 
system  is  maximized  by  ITDT  products  directed  at  the  novice  acquiring  and 
sustaining  those  individual/crew  operator  skills  and  maintenance  skills 
most  critical  to  apprentice  and  journeyman  job  duties  wherever  the  system, 
its  personnel  subsystem,  and  unit  are  located.  Draft  AR  1000-2  makes 
ITDT  coverage  an  integral  feature  of  all  major  new  developmental  systems;  no 
system  will  be  permitted  to  enter  OT-II  without  it.  Also,  the  provision  of 
ITDT  coverage  for  selected  fielded  systems  is  being  accelerated.  A joint 
DARCOM/TRADOC  ITDT  Working  Committee  has  nominated  candidate  developmental 
systems  for  ITDT  coverage  in  the  FY  76-79  period  and  candidate  fielded  systems 
for  ITDT  in  the  FY  77-81  period. 

Figure  2-2  shows  how  ITDT  activities  relate  to  the  equipment  acquisition  events 
and  logistics  analysis  inputs  in  a typical  system  procurement  action.  This 
ITDT  process  generally  parallels  the  instructional  systems  development  (ISD) 
process  of  system  job/task  analysis,  training  program  design,  and  instructional 
program  development/validation  as  guided  by  TR.AD0C  Pamphlet  350-30.  For  ITDT, 
however,  the  process  is  modified  to  provide  foi?  the  concurrent  and  integrated 
development  of  both  technical  documentation  (simplifying  what  to  do)  and 
training  (teaching  how  to  do  and  providing  supportive  performance  practice 
with  the  job  materials).  Thus,  the  front-end  data  collection  and  analysis  is 
geared  to  serve  both  documentation  and  training  development  needs;  the 
selection  of  tasks  for  training  is  conditioned  by  the  highly  illustrated, 
simple  to  read  information  which  will  be  available  in  the  technical  documenta- 
tion for  on-the-job  use;  and  the  training  is  designed  to  reinforce  and  supple- 
ment the  job  performance  steps  presented  in  the  technical  manuals. 

^TRADOC/DARCOM,  "Technical  Documentation  and  Training  Acquisition  Handbook". 

Revised  9 May  1977. 
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Figure  2-2.  ITDT  Development  In  an  LCSMM  Context 
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The  Army  is  attempting  to  put  "teeth"  into  the  ITDT  process  and  product  re- 
quirements by  preparing  ITDT  military  specifications  covering  front-end 
analysis,  operator  manuals,  three  levels  of  maintenance  manuals  (organizational, 
direct,  and  general  support),  and  supportive  extension  training  products.  A 
draft  set  of  ITDT  Mil  Specs  are  undergoing  revisions  for  near-term  (FT  77-78) 
procurement  actions,  based  upon  lessons  learned  from  such  existing  ITDT 
demonstration  projects  as  Tank  Turrets,  '.■Jheeled  Vehicles,  and  TACFIRE.  Current 
work  is  underway  on  a more  comprehensive  revision  to  the  specifications  for 
use  in  the  post-78  period.  The  Army  has  sponsored  parallel  preparation  of  a 
Technical  Docximentation  and  Training  Acquisition  Handbook  to  facilitate  the 
joint  work  of  materiel  developers  and  training  developers  charged  with  imple- 
menting ITDT  within  the  Amy  total  systems  life-cycle  management  model.  This 
document  has  undergone  two  revisions  based  upon  joint  DARCOM/TRADOC  review 
inputs  since  distribution  of  a first  draft  on  28  January  1977.  Also,  as  part 
of  the  TRADOC  Staff  and  Faculty  Development  Program,  TDI  is  sponsoring  the 
preparation  of  workshops  to  target  the  special  ITDT  awareness  needs  of  service 
school  senior  managers,  interface  responsibilities  of  DARCOM  Program  Managers 
and  TRADOC  System  Managers,  and  implementation  skills  for  mid-managers  and 
their  technical  specialists. 

F.  LIFE-CYCLE  SYSTEM  AND  JOB  SPECIALTY  PROPONENCY  OF  SERVICE  SCHOOLS 

Service  schools  are  being  designated  responsible  as  user  representatives  for 
the  integrity  of  a system  and  its  personnel  and  training  subsystems  throughout 
the  system  life-cycle,  from  inception  to  obsolescence.  Thus,  the  USAFAS  is 
proponent  for  TACFIRE  and  BCS,  and  will  be  proponent  for  XM-204,  SP  Arty  Total 
System,  and  Towed  Arty  in  FY  78-81.  This  life-cycle  proponency  responsibility 
includes  MOS  proficiency  of  the  personnel  subsystem  from  Army  entry-to-exit, 
maintenance  of  field  forces  job  proficiency,  and  overall  responsibility  for 
weapons  system  performance  effectiveness.  Key  aspects  of  the  service  school 
proponency  role  as  user  representative  include:  (1)  focus  on  forces  in  the 
field;  (2)  provide  individual  training;  (3)  provide  collective  training;  (4) 
centralize  responsibility  in  a TRADOC  Systems  Manager. 
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1.  Focus  on  Field  Forces 

The  service  schools  are  not  viewed  as  ends  in  themselves.  They  must 
contribute  to  field  forces  individual  job  task  and  collective  mission 
proficiency  by  supporting  training  conducted  where  the  Army  systems 
and  jobs  are.  The  goal  is  about  90  percent  unit  training  and  10 
percent  institutional. ^ The  key  to  school  system  technical  proponency 
will  be  a well  done  job/duty  positional  analysis  (job  analysis)  for 
the  main  operations  and  maintenance  functions  of  each  weapons  system 
for  which  the  school  is  proponent.  The  most  critical  Individual  and 
collective  personnel  subsystem  tasks  representing  the  hard-core  of 
soldier  jobs  are  selected  for  training.  These  tasks  must  be  allocated 
to  a training  setting  and  delivery  system  for  acquiring  initial  com- 
petency and  sustaining  proficiency,  considering  that  there  is  an 
Increasing  need  to  deliver  training  and  evaluation  away  from  the 
school.  Decisions  on  the  specific  specialties,  skill  levels  and  jobs 
to  be  trained,  including  choice  of  training  settings  and  delivery 
systems  rationale  will  be  identified  by  the  user  representative  In 
the  Individual-Collective  Training  Plan  (ICTP).  This  becomes  the 
proponent  school's  game  plan  for  field  unit  support  from  which  other 
developments  proceed. 

2.  Individual  Training  Oriented  to  Soldier  and  Job 

Individual  training  is  that  which  is  conducted  for  the  soldier  to  give 
him  the  skills  and  knowledges  he  needs  to  do  his  job.  Job-based 
training  will  be  of  the  highest  priority,  recognizing  that  the  soldier's 
central  identification  is  his  job  and  that  Individual  job  competence 
is  prerequisite  to  collective  mission  competence.  For  an  Army  Weapons 
or  tactical  system,  jobs  Include  rifleman,  grenadier,  scout,  radio 
operator,  gunner,  and  artillery  control  console  operator — not  the 
soldier's  primary  MOS.  Individual  job  training  performance  standards 
should  be  assessed  by  Skill  Qualification  Tests  (SQT)  to  determine  the 
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Gorman,  MG  Paul  F.  "The  Army  Training  System."  TRADOC  Video  Tape 
#777-0461  dated  17  January  1977. 
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skill  level  at  which  the  soldier  is  qualified  on  critical  tasks.  The 
SQT  and  Job-Book  are  intended  to  provide  the  soldier  and  his  job  super- 
visor with  a guide  for  individual  job-oriented  training  progress  and 
training  needs. 

3.  Collective  Training  Oriented  to  System  and  Mission  Effectiveness 

Collective  training  refers  to  the  developing  in  a group  of  soldiers, 
a crew,  squad,  platoon,  and  higher  levels,  those  interdependencies 
and  teamwork  necessary  for  effective  team  performance.  The  Army 
Training  and  Evaluation  Program  (ARTEP)  has  been  developed  to  contain 
mission-essential  and  performance  oriented  collective  training  stan- 
dards as  guidance  for  unit  commanders.  The  ARTEP  highlights  the 
critical  tasks  which  a unit  must  be  able  to  perform  at  various  col- 
lective levels  from  squad  to  Division  or  Force  to  be  successful  and 
survive  in  battle. 

4.  Important  Role  of  the  TRADOC  System  Manager  (TSM) 

A TSM  for  total  system  management  at  the  proponent  school  will  be 
appointed  concurrent  with  a DARCOM  Program  Manager  (PM) , preferably 
early  in  the  system  requirements  and  concept  definition  phase. 

Figure  2-3  shows  the  general  role  of  the  proponent  school  TSMs.  As 
currently  understood,  the  TSM  will  interface  with  the  school  commandant 
and  will  have  tasking  authority  which  cuts  across  school  resources. 

His  responsibilities  include  ensuring  the  critical  combat  developer's 
interface  with  fralnlng/course  developers  in  the  school,  coordination 
with  DARCOM  PMs  and  TRADOC  Systems  Support  Officer  (TRASSO)  at  Ft. 
Monroe,  and  representing  the  system  to  DCSOPERS  and  others  on  Capitol 
Hill.  Thirty  TSMs^  have  been  identified  from  MILPERCEN  to  represent 
major  (24)  and  non-major  (6)  developmental  systems.  Each  TSM  will 
have  a project  staff  consisting  of  an  officer  for  personnel,  for 
training,  and  for  logistics,  and  a secretary. 
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Burdeshaw,  BG  William.  "Army  Total  Systems  Management." 
Presentation  at  C.  R.  I.  Sr.  Managers  Course,  Hampton,  Va. 
20  April  1977. 


G.  VOLUME  OF  POTENTIALLY  USEFUL  TRAINING- EVALUATION  RESOURCES 

A potential  problem  faced  In  selecting  an  appropriate  mix  of  delivery  systems 
is  the  sheer  volume  of  method-media  innovations  either  fielded,  nearing 
exportable  form,  or  in  various  phases  of  exploratory  -development . Part  of 
the  problem  is  simply  awareness  of  the  options.  Table  2-2  provides  a partial 
list  of  the  kinds  of  delivery  systems  potentially  available  for  packaged 
export,  remote  access,  integration  into  systems,  or  usable  at  USAFAS  for 
training  and  evaluation  in  the  FY  78-83  period. 

The  capabilities  and  constraints  of  these  delivery  systems  do  vary  and  will 
require  tradeoff  considerations  for  any  given  instructional  situation.  These 
considerations  are  summarized  in  Section  5 of  this  report. 

H.  MUTUAL  RESPONSIBILITIES  FOR  TRAINING  AND  EVALUATION 

The  changing  roles  of  Army  organizations  will  impact  on  how  and  where  training 
resources  are  selected  and  utilized  in  the  upcoming  five  years.  Commander, 
TRADOC  will  provide  policy  and  guidance  for  the  development,  implementation, 
and  evaluation  of  individual  and  collective  training  to  meet  training  needs 
Army-wide . 

1.  Field  Forces 

The  responsibility  for  conducting  and  managing  individual  and  collec- 
tive training  and  administering  individual-collective  evaluations  will 
primarily  reside  close  to  field  force  jobs  and  systems  (active  and 
reserve),  at  unit  battalion  levels  and  lower.  This  will  be  true 
whether  the  unit  is  In-garrison,  a local  training  area,  or  a major 
training  area.  FM  21-6  and  TC  21-5-7  provide  guidance. 

2.  Army  Service  Schools 

Service  schools,  including  resident  TRADOC  System  Manager(s),  will 
provide  a system,  job,  and  MOS  proponency  function  as  user  represen- 
tative of  field  forces.  The  responsibility  for  designing,  developing. 


Table  2-2 


Summary  of  Training  and  Evaluation  Resources 


1.  SQT  and  ARTEP  program  materials. 

2.  Combat  and  Training  Literature  (FM  100-5,  How-to-Fight  Manuals,  Commanders 
Manuals,  Soldiers  Manuals,  FM  21-6,  TC  21-5-7,  Job  Books). 

3.  Army  Correspondence  Course  Program  materials. 

4.  TEC  program  and  Self-Pacing  program  materials  (audiovisual,  print,  audio). 

5.  Existing  FMs,  TMs,  and  job-aids. 

6.  Tech  manuals,  job-aids,  and  training  materials  from  ITDT  programs. 

7.  Television  (CCTV,  mobile  units,  field  playback  devices,  field  TVT  devices, 
regional  production  units). 

8.  Manual  Command/Tactical  Exercises  (SAND  TABLE,  board  games,  TEWTS,  CPX 
Simulation  Facility  at  USAFAS). 

9.  Computer-Mediated  Training  Support: 

• Tactical  systems  Embedded  Training  (PLANIT) 

• Schools  CAI/CMI  support  systems  (ABACUS,  PLANIT) 

• Command  maneuver  and  tactical  exercises  (CAMMS  and  CATTA;  Ft.  Leavenworth) 

• Computer-based  CPX  support  (Inter-Data  at  USAFAS) 

10.  Training  Devices  and  Simulators: 

• Observed  Fire  Panoramic  Simulator  (at  USAFAS) 

• Mini-Range  Trainer  (at  USAFAS) 

• Subcaliber  Devices 

• Devices  and  targets  from  Marksmanship/Gunnery  Laser  Devices  (MAGLADS) 

program 

• Helicopter  Flight  Simulators 

11.  Engagement  Simulations  permitting  two  sided  exercises: 

• Squad  Combat  Operations  Exercise  Simulated  (SCOPES) 

• REALTRAIN  (permits  artillery,  tanks,  mines,  antitank  weapons  to  exercise) 

• Multiple  Integrated  Laser  Engagement  System  (MILES) 

12.  Information  Storage,  Retrieval,  Transmission 

• Training  Developments  Information  System  (TDIS) 

• Micrographics 

• Vldeodlsk 

• Satellite  Transmission 


evaluating,  and  updating  of  exportable  individual-collective  training 
and  evaluation  methods  will  reside  primarily  in  the  schools.  This 
includes  the  front-end  analysis  required  to  select  tasks,  training 
settings,  and  delivery  systems.  Schools  will  also  implement  training 
appropriate  for  conduct  at  the  service  school,  and  individual  training 
courses  for  implementation  in  Army  Training  Centers. 

Army  Training  Centers 

ATCs  will  implement  training  courses  provided  by  service  schools  and 
provide  subject  matter  experts  to  assist  service  school  training 
development  programs  as  required. 

Army  Training  Support  Center 

ATSC  will  serve  as  conduit  for  access  by  schools,  units  and  soldiers 
to  all  forms  of  materials  produced  under  the  Army  TEC,  Correspondence 
Course,  Combat  Literature,  and  Training  Literature  programs.  The 
responsibility  for  reviewing,  integrating,  packaging,  production, 
distribution,  and  inventory  control  of  exportable  packages  originating 
in  service  schools  will  reside  primarily  in  ATSC.  ATSC  support  will 
also  include  a centralized  repository  of  combined  arms  common-job-task 
data,  as  well  as  centralized  record  keeping  on  training  evaluation 
(SQT,  ARTEP)  results  for  feedback  to  unit  commanders  and  support  of 
DA  DCSPER  and  MILPERCEN  qualitative  personnel  management  needs. 

TRADOC  Training  Developments  Institute 

TDI  will  provide  a TRADOC  Staff  and  Faculty  Program  to  develop  and 
sustain  knowledges  and  skills  in  managing,  developing,  implementing, 
and  evaluating  self-paced  performance  training  for  all  members  of 
service  schools,  training  centers,  etc.,  and  will  support  service 
school  course  development  missions  with  resources  of  the  TRADOC 
Self-Paced  Instruction  and  ITDT  programs. 


2-18 


6.  Army  Training  Board 

Responsible  for  monitoring  and  providing  feedback  to  proponent  schools, 
ATSC,  and  TDI  on  the  effectiveness  and  efficiency  of  fielded  training 
support  systems.  Responsible  for  developing  and  Implementing  training 
management  systems  for  active  and  reserve  field  forces. 

These  roles  are  being  further  defined  In  TRADOC  Reg.  350-100-1  Analysis, 
Development  and  Evaluation  of  Individual  Training  (to  be  published). 

I.  SCHOOL  RESPONSIBILITIES  FOR  RESOURCES  MANAGEMENT 

Presently,  and  In  the  foreseeable  future,  the  service  schools'  most  needed  and 
costly  resource  will  be  people — particularly  officer  end-strength  and  civilian 
full-time  spaces.  From  a resources  management  standpoint,  the  general  goals 
for  Institutional  courses  will  be  to:  (1)  maintain  or  increase  student  loads 
and  course  frequency;  (2)  achieve  more  student/fewer  Instructor  ratios;  (3) 
reduce  overall  training  time;  and  (4)  reduce  Instructor  contact  hours  (ICH). 

To  achieve  this,  more  decentralized  and  less  Instructor-intensive  course 
design-development  priorities  will  be  favored;  specifically: 

exportable,  system/job-embedded , or  remote  access  job  training 
self-pacing  of  Institutional  courses 

Figure  2-4  shows  the  kinds  of  positive  results  that  USAFAS  has  achieved  from 
self-pacing  of  the  82C  Survey  course — more  students  Input  and  the  course 
conducted  oftener,  with  both  ICH  and  number  of  Instructors  down.  Similarly, 
after  redeveloping  the  ADO  Advanced  Course  at  Ft.  Bliss,  student  loads 
Increased  by  62  percent,  course  length  was  reduced  by  19  percent,  and  ICH 
went  down  11  percent.^  The  Incentive  to  service  schools  is  that  the  savings 
from  lower  ICH  can  be  used  to  divert  manpower  to  other  product  workload 
requirements. 


Thurman,  BG  M.  "Resource  Management  at  TRADOC",  Handout  and  Videotape 
909-777-0464-B,  TRADOC,  DCSRM,  15  March  1977. 
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Figure  2-4.  Payoff  From  Self-Pacing  82C  Survey  Course  at  USAFAS 


Figure  2-5  shows  the  service  school  organization  design  model^  currently  ^ 

advanced  by  DCSRM,  TRADOC  as  "School  Model  76."  Local  variations  on  this  i 

model  include:  Ft.  Knox,  where  the  "design"  components  of  the  Individual- 
Collective  Training  Divisions  are  moved  into  the  Course  Development  Division; 

Ft.  Sill,  where  design  and  various  development  activities  are  merged  into 
another  Directorate,  Course  Developments;  and.  Ft.  Benjamin  Harrison  with 
a matrix  design  for  ad-hoc  flexibility. 

During  FY  78-83,  the  need  to  integrate  training  and  evaluation  analysis, 
design,  and  delivery  system  selection  activities  in  a "baseline-to-design" 
Individual-Collective  Training  and  Evaluation  Plan  (ICTEP)  for  system/MOS 
life-cycle  proponency  is  predicted  to  Increase.  This  implies:  (1)  focus 
on  the  TRADOC  System  Manager (s)  for  cross-organization  integration  and 
decision-making;  (2)  focus  on  the  Resource  Manager  for  utilizing  manpower 
skills  flexibly;  (3)  coordination  efficiencies  through  less  fractionated 
organization  design. 


^Thurman,  BG  M.  "School  Model  76".  Handout  and  videotape  777-0463,  TRADOC 
DCSRM,  31  Jan  77. 
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Figure  2-5.  System  and  Resource  Managers  In  School  Model-76 
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SECTION  3:  U SAFAS  TRAINING  SUPPORT  SITUATIONS  FY  78-83 

Section  2 described  evolving  DA/TRADOC  regulatory  initiatives,  guidance,  and 
delivery  system  trends  as  the  external  context  influencing  training  and  eval- 
uation resources  utilization  during  FY  78-83. 

This  section  first  identifies  the  various  factors  that  can  influence  decisions 
on  the  optimal  delivery  systems  (method-media  mix)  for  a training  program. 

For  any  given  program  development  requirement,  the  realistic  solutions  and 
constraints  will  vary.  Several  instructional  development  situations  postulated 
as  likely  USAFAS  requirements  for  FY  78-83  are  described  and  contrasted  in 
terms  of  impacts  on  delivery  systems  selection  factors. 

A.  FACTORS  INFLUENCING  DELIVERY  SYSTEM  DECISIONS 

Instructional  delivery  systems  (method-media  and  media  mix)  determine  how  the 
training  is  to  be  presented  to  the  trainee  and  how  the  student  is  to  respond. 
Examples  of  delivery  systems  include  the  instructor  or  job-training  supervisor, 
books,  films,  slides,  recordings,  videotape,  computer  terminals,  simulator 
devices,  and  engagement  simulations.  The  selection  of  delivery  system  con- 
figurations is  based  primarily  upon  the  type  of  situational  presentations, 
symbolic  or  actual  responses,  and  feedback  specified  for  each  training  module 
and  for  successive  levels  of  performance  modules  within  a training  program; 
together  with  considerations  on  characteristics  of  the  soldier  users.  This 
results  in  a candidate  list  which  is  subject  to  further  scruitiny  based  upon 
a number  of  potential  constraints  including  cost-effectiveness. 

Figure  3-1  summarizes  the  delivery  systems  selection  problem  in  terms  of  the 
factors  which  can  influence  decisions  on  a realistic  optimum  delivery  system 
configuration  for  a training  program.  The  "Selection  Factors"  are  the  student 
characteristics  and  subject-matter  characteristics  which  would  be  of  primary 
concern,  all  other  things  being  equal.  The  "Solution  Factors"  are  those 


Figure  3-1.  Delivery  System  Selection,  Constraint,  and  Solution  Factors 


method-media  attributes  which,  ideally,  would  be  matched  as  closely  as  possible 
to  requirements  of  the  selection  factors  to  arrive  at  an  optimal  delivery 
system  decision.  Realistically,  however,  the  "Constraint"  factors  shown 
indicate  the  actual  or  potential  limitations  that  will  condition  any  decision 
based  solely  on  student,  subject  matter,  and  delivery  system  considerations. 

Several  of  the  constraint  factors  shown  in  Figure  3-1  warrant  brief  mention. 
There  is  a major  interaction  between  the  selection  of  individual-team  training 
settings  and  the  selection  of  delivery  systems.  The  capabilities  and/or  cost 
of  a particular  type  of  delivery  system  may  be  a deciding  factor  in  the  training 
setting  selection  process;  similarly,  the  training  setting  may  dictate  the 
appropriateness  of  a particular  type  of  delivery  system.  Together,  an  optimal 
selection  of  settings  and  configuration  of  delivery  systems  should  provide 
the  most  effective  and  efficient  training  to  those  who  require  the  training 
and  at  the  point  in  time  when  the  training  is  most  needed  by  the  trainees. 


The  Army/TRADOC  regulations  and  directives  chosen  to  guide  a particular  training 
program  development  activity  will  serve  to  define  requirements  and  constrain 
such  factors  as  potential  training  settings  and  candidate  delivery  systems. 

For  example,  AR  1000-2,  ITDT  Mil  Specs,  and  the  Cost-Training  Effectiveness 
Analysis  (CTEA)  methods  in  TRADOC  Reg  11-8  and  TRADOC  Pams  11-10  or  11-73  will 
provide  more  specific  constraints  on  delivery  systems  than  the  general  guidance 
of  the  ISD  volumes  (TRADOC  Pam  350-30) . 

The  available  source  data  and  existing  training  materials  will  be  a major 
influence  on  candidate  delivery  systems  when  self-pacing  or  retrofitting 
training  for  a system  or  specialty  already  fielded,  as  compared  to  the  data 
and  existing  materials  available  for  input  to  a new  system  or  specialty 
training  program  development. 
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B.  USAFAS  SITUATIONAL  RESOURCE  SELECTION  PROBLEMS 

Types  of  development  requirements  predicted  for  USAFAS  during  FY  78-83  are 
as  follows: 

Situation 

1 - ITDT  Coverage  of  New  or  Developmental  System 

2 - ITDT  Retrofit  to  Fielded  System 

3 - Self-Pacing  of  MOS  Course  for  Export 

4 - Self-Pacing  of  MOS  Course  for  Institution 

5 - Update  of  Fielded  ITDT/MOS  Materials 

The  following  paragraphs  summarize  the  Implications  of  each  of  these  require- 
ments on  several  selection,  solution,  and  constraint  factors  shown  above  In 
Figure  3-1. 

1.  ITDT  Coverage  of  New  or  Developmental  System 

a.  Situation 

USAFAS  Is  designated  within  the  DA  total  systems  management 
initiative  as  responsible  for  the  life-cycle  proponency  of  per- 
sonnel, logistics,  and  training  support  Including  Integrated 
Technical  Documentation  and  Training  (ITDT)  coverage  for  several 
Army  Systems  (the  Tactical  Fire  Direction  System  (TACFIRE), 
Battery  Computer  System  (BCS),  or  XM-204. ) 

b.  Selection  Factor  Impacts 

Trainee  Characteristics.  Job  design  and  personnel  requirements 
Information — jobs,  density  and  location,  EPMS/OPMS  plans,  manning 
plans  for  test  and  fielding — should  be  an  outcome  of  personnel 
subsystem  design  during  the  system  concept /requirements  phase. 

The  front-end  analysis  phase  should  obtain  data  on  soldier 
intelligibility-comprehension  requirements  for  use  as  design 
criteria,  with  trainee  profile  and  performance  data  obtained  from 


developmental  validation,  verification,  and  DT/OT-II.  Job 
incumbent  profile,  job  performance,  training  acceptance,  and 
SQT/ARTEP  feedback  data  is  obtained  after  the  system  is  fielded, 
jobs  are  manned,  and  training  is  implemented. 

Individual-Collective  Tasks.  The  main  focus  for  the  ITDT  job-aid 
and  training  support  package  will  be  critical  operator/crew  and 
maintenance  tasks  from  novice  through  Skill  Levels  1 and  2, 
apprentice  and  journeyman.  Technical  manuals  will  focus  on 
critical  job  tasks  at  all  skill  levels  selected. 

Constraint  Factor  Impacts 

Primary  Regulatory  Directives:  AR  1000-2  (26  Dec  76),  AR  1000-1; 

ITDT  draft  Mil  Specs  for  front-end  analysis,  operator  manuals, 
maintenance  manuals,  and  training  materials;  TRADOC  Reg  350-100-1 
(13  Apr  77  working  draft);  TRADOC  Reg  11-8  and  TRADOC  Pan  11-10  on 
CTEA;  Army  Technical  Documentation  and  Training  Acquisition 
Handbook  (9  May  77  revision) . 

Primary  Source-  Data.  System  operating  concept  documents,  system 
design  specifications,  engineering  data,  system  planning  and 
management  data,  logistics  support  analysis  data,  organizational 
and  manning  plans,  test  plans,  system  design  personnel,  and  combat 
developer-training  developer  subject  experts. 

Training  Setting.  The  goal  is  to  field  a complete  operator/crew 
and  maintenance  job-support  package  Including  initial  and  sustaining 
training  to  be  available  with  the  fielded  system  and  unit,  whatever 
the  location.  The  primary  training  setting  is  the  system  and 
job-duty  location,  or  suitable  unit  self-study  areas. 

Lead  Time  and  Costs.  Lead  time  for  new  developmental  system  ITDT 
coverage  will  parallel  the  overall  system  acquisition  cycle.  ITDT 


will  be  relatively  well  funded,  based  partly  upon  lessons  learned 
in  current  ITDT  demonstration  projects  (Tank  Turrets,  Wheeled 
Vehicles,  TACFIRE,  BCS) . Funding  will  include  contracted  work  for 
materiel  system  development  and  production.  It  may  also  include 
contracted  work  for  front-end  analysis,  training  design,  develop- 
ment of  training  simulation  devices,  and  development  of  the 
technical  manual  and  training  support  packages. 

School  Support  Capability.  The  proponent  school  will  be  respon- 
sible for  providing  combat  developer,  training  developer,  course 
design-development,  and  evaluation  inputs  throughout  the  system 
life-cycle.  USAFAS  developers  may  be  required  to  integrate  over- 
all EPMS/OPMS  specialty  plans  with  the  system  and  job-duty  focus 
of  ITDT  coverage.  The  focal  points  for  coordinating  external 
and  internal  management  of  needs  and  resources  will  be  the  TRADOC 
System  Manager  (TSM)  and  Resource  Manager  at  USAFAS.  Since  one 
of  the  goals  of  AR  1000-2  is  to  reduce  overall  life  cycle  system 
costs,  USAFAS  combat  and  training  developers  with  the  TSM  may 
need  to  provide  a mini-C0EA/CTE.\  (TRADOC  Reg  11-8)  as  initial 
justification  for  major  training  development  requirements  in 
the  concept/requirements  generation  phase.  Then,  based  upon 
DT/OT-I  results,  expansion  of  the  COEA  or  CTEA  may  be  required 

f 

before  proceeding  into  production — especially  where  expensive 
training  simulation  devices  are  concerned.*  Assistance  for  COE.A/ 
CTEA  preparation  can  be  obtained  from  TRASANA  (TRADOC  Systems 
Analysis  Activity).  Since  ITDT  may  be  contracted-out,  USAF.AS 
should  be  prepared  to  state  requirements  for  training  analysis 
and  design,  characteristics  of  trainees,  delivery  system  criteria. 


* Appendix  A-3  provides  an  example  of  a CTEA  (Cost  and  Training  Effective 
.Analysis)  for  an  advanced  T.ACFIRE  training  system  for  which  USAFAS  is 
proponent. 
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and  product  evaluation  standards.  The  methods-media  and  inan- 
power  skills  to  review  and  revise  ITDT  products  should  exist  at 
USAFAS . 

d.  Delivery  System  Solution  Impacts 

The  delivery  system  under  ITDT  coverage  is  the  entire  job-support 
package  to  be  fielded  with  the  system.  The  components  of  this 
package  are  shown  in  Table  3-1.**  Requirements  include:  (1) 
Technical  Documentation  (operator  and  maintenance  manuals)  suitable 
for  use  by  all  system  personnel,  novice  to  experienced;  (2)  Train- 
ing Support  Package  consisting  of  job  performance  guides  and  a 
mix  of  extension  training  delivery  systems,  including  various 
training  management  materials,  to  permit  acquiring  and  practicing 
skills  needed  in  applying  the  technical  documentation  to  critical 
job  tasks.  Eligible  extension  training  material  (ETM)  options 
include  the  three  primary  TEC  media  tracks,  as  well  as  simulation 
devices,  tactical  simulations,  and  computer-mediated  training 
support  as  appropriate  for  the  object  system.  The  primary  eligible 
training  methods  are  SOJT  or  self-paced  study  and  practice.  Delivery 
system  decisions  for  ITDT  should  be  integrated  and  compatible  with 
decisions  for  object  system  MOS  courses.  Soldiers  Manuals,  SQTs , 
and  ARTEP. 

2 . ITDT  Retrofit  to  a Fielded  System 

a.  Situation 

USAFAS  is  designated  by  DA  on  a selective  basis  to  provide  ITDT 
coverage  for  a system  already  fielded;  for  example,  SP  ARTY 
Total  System  (M107/110/109/109A) , and  TOWED  ARTY  systems.  The 


**From  DARCOM/TRADOC,  "Technical  Documentation  and  Training  Acquisition  Hand- 
book," (draft)  revised  9 May  1977. 


rr 


L' 
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Table  3-1.  Typical  ITDT  Package  Contents 


DOCUMENTATION 


• Maintenance  Manuals  (JPM  format)* 


Volume  I: 
Volume  II: 
Volume  III: 
Volume  IV: 


Reference  Data  and  Installation  Instructions 
Scheduled  Maintenance 
Troubleshooting 
Corrective  Maintenance 


or  ("new  look"  format)* 


- TM  9-XXX-XXX-20 

- TM  9-XXX-XXX-30 

- TM  9-XXX-XXX-40 


Organizational  Maintenance 
Direct  Support  Maintenance 
General  Support  Maintenance 


Operators  Manual  ("new  look"  format) 


- Chapter  1 

- Chapter  2 

- Chapter  3 

- Chapter  4 

- Chapter  5 


Introduction 
Operating  Instructions 
Maintenance  Instructions 
Maintenance  of  Auxiliary  Equipment 
Ammunition 


TRAINING 


Training  Management  Guide  (TMG) 

Student  Guide  (SG) 

Job  Performance  Guide  (JPG) 

Lesson  Administrative  Instructions  (LAI) 
Student  Lesson  Sheets  (SLS) 


ETM  Media  Materials  (Options) 


- Track  1 

- Track  2 

- Track  3 

- Other: 


Audio  Visual 

Written 

Audio 

(CAI,  simulation  devices,  etc.) 


*Manuals  will  use  either  JPM  or  "new  look"  format,  depending  on 
specific  system  application. 
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main  focus  is  on  integrating  technical  manuals,  job  aids, 
and  exportable  training  into  a total  system  job-support  package 
at  an  appropriate  intelligibility  level  for  the  job  incumbents. 

b.  Selection  Factor  Impacts 

Trainee  Characteristics.  This  should  include  personnel  data, 
performance  data,  and  attitudes  of  actual  job  incumbents  from 
Army  files,  SIDPERS  data  base,  job  survey  and  interview  with 
unit  training  NCOs.  This  will  permit  evaluating  problems  to 
determine  if  solutions  should  target  trainees  (e.g.,  materials 
intelligibility)  or  other  factors  such  as  system  hardware, 
personnel  selection,  or  unit  organizational  effectiveness. 

Individual-Collective  Tasks.  Same  as  for  Situation  1,  critical 
operator/crew  and  maintenance  tasks.  This  may  or  may  not 
include  redoing  the  front-end  job  task  analysis  depending  upon 
an  assessment  of  existing  job  and  performance  problems  and 
effectiveness  of  existing  training  and  technical  manuals. 

c.  Constraint  Factor  Impacts 

Primary  Regulatory  Directives.  Same  as  for  Situation  1,  ITDT 
coverage  of  new  developmental  systems.  However,  the  start 
point  in  the  ITDT  retrofit  process  (front-end  analysis,  mate- 
rials design,  or  development)  will  depend  upon  an  assessment 
of  the  adequacy  of  existing  job-training  products. 

Primary  Source  Data.  Technical  publications  for  the  existing 
system,  modification  instructions,  unsatisfactory  condition 
reports,  maintenance  bulletins,  job  surveys  of  job  incumbents 
and  their  supervisors,  existing  unit  job-aids  and  training 
(e.g.,  SQT,  ARTEP)  and  combat-training  literature  (FMs,  Soldiers 
Manuals,  etc.). 


Training  Setting.  Same  as  for  Situation  1,  the  fielded  system 
and  unit,  whatever  the  location. 
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Leadtlme  and  Costs.  Leadtime  and  funding  will  depend  upon  the 
number  of  ITDT  phases  to  be  performed  in  the  retrofit  process, 
the  types  of  technical  documentation  and  training  support  to 
be  produced,  and  the  Impacts  on  existing  manuals  and  MOS 
training  and  evaluation  materials.  This  will  also  influence 
what  portion  of  the  work  is  done  at  USAFAS  or  contracted-out. 
Funding  estimates  for  ITDT  retrofit  of  specific  Field  Artillery 
System  range  from  1.5  million  to  5 million  dollars.^ 

School  Support  Capability.  Same  as  described  for  Situation  1. 
However,  a primary  USAFAS  problem  will  be  to  determine  how  ITDT 
changes  will  influence  existing  MOS  courses.  Soldiers  Manuals, 

SQTs,  and  ARTEP  and  either  assure  contractor  Integration  or 
schedule  in-house  development  changes. 

d.  Delivery  System  Solution  Impacts 

Delivery  system  impacts  are  the  same  as  discussed  for  Situation  1. 
However,  efficiency  should  dictate  a close  assessment  of  the  exist- 
ing technical  manuals,  training  packages/devices,  and  evaluation 
methods  for  possible  use  or  adaptation  before  imposing  new 
development  requirements.  For  example,  the  primary  solution 
may  be  redoing  the  technical  manuals  in  ITDT-speclf led  formats 
r such  that  they  are  shown  by  government  verification  and  develop- 

mental/operational tests  to  meet  intelligibility-comprehension 
requirements  for  successful  task  performance.  Existing  TEC 
packages,  job-aids,  and  training  devices  may  be  sufficient 
given  the  ITDT  student  guide  and  training  management  guide. 

The  creation  of  new  manuals,  aids,  and  training  materials  will 
create  revision  requirements  to  existing  SQTs,  Soldiers  Manuals, 
TEC,  and  ARTEP.  The  tasks,  conditions,  and  standards  may  also 
be  changed  if  the  retrofit  requires  a new  front-end  job  task 
analysis . 


"Record  of  ITDT  Working  Committee  Meeting,  22-24  September  1976 
at  Hq  TRADOC".  Training  Management  Institute,  Ft  Eustls,  VA. 

27  September  1976. 
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3.  Self-?acini?  of  MOS  Course  for  Export  to  Units 

a.  Situation 

USAFAS  developers  are  designated  responsible  for  preparing  all  or 
portions  of  an  existing  MOS  school  course  for  self-paced,  indivi- 
dual jobs  proficiency  training  for  export  to  and  use  in  field 
artillery  unit  job  settings  or  learning  center.  Recent  examples 

include  USAFAS  responsibility  for  preparing  exportable  packages  \ 

for  branch-unique  tasks  of  the  combined  arms  Operations/Intelli-  ! 

gence  NCO  course,  and  export  of  TEC  lessons  for  MOS  13E  Skill 

Levels  1 and  2.  Each  field  artillery  battalion  is  programmed 

to  receive  some  400  TEC  lessons  that  will  provide  self-paced, 

self-study  MOS  training  and  cover  many  of  the  job  tasks  performed 

in  a battalion. 

b.  Selection  Factor  Impacts 

Trainee  Characteristics.  Exportable  packages  are  produced  for 
an  Identifiable  pool  of  existing  or  potential  MOS/job  incumbents. 

The  EPMS/OPMS  specialty  skill  level  duties  and  tasks  for  unit- 
level  job  training  will  normally  be  specified  in  the  USAFAS-pro- 
duced  Individual  Training  Plan  or  Commander's  Manual  for  the  MOS. 

For  the  selected  MOS  skill  levels,  approximate  central  value, 
range,  and  dispersal  on  AQB/ACB  subtest  scores,  length  of  service, 
rank/grade,  prior  training,  years  of  civilian  education,  and 
tine  in  duty  position  may  be  available  from  unit  or  central  DA 
data  files. 

Individual-Collective  Tasks.  Job  duties  and  tasks  in  the  MOS 


Individual  Training  Plan,  Soldiers  Manuals,  SQTs,  ARTEP  and 
supportive  job-task  analysis  data  will  be  primary  sources  of 
critical  tasks,  conditions,  and  standards.  Tasks  allocated 
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in  the  Commander's  Manual  to  unit  SUJT  or  self-study,  including 
compatible  Soldiers  Manual  and  SQTs  for  the  selected  MOS  skill 
levels  are  the  candidate  tasks  for  unit  exportable  packages. 

c.  Constraint  Factor  Impacts 

Primary  Regulatory  Directives.  TRADOC  Reg  350-100-1  (draft),* 

TC  351-3  (being  revised),  AR  611-3  on  job-cask  analysis,  SQT 
Developers  Handbook,  TC  21-5-3,  TC  21-5-7,  FM  21-6,  and  TRADOC 
Pam  350-30  (ISD) . The  applicable  portions  of  these  directives 
and  guidance  will  depend  upon  assessments  and  decisions  on  whether 
or  not  self-pacing  requires  redoing  the  front-end  job  task  analysis. 

Primary  Source  Data.  Field  feedback  data,  including  job  surveys 
and  CODAP  (Computerized  Occupational  Data  .Analysis  Program) 
outputs.  Unit  performance  data  on  live-fire,  FTXs,  CPXs,  SQT, 
and  ARTEPS  from  unit,  FORSCOM  division,  or  .ATSC  data  files. 
Individual  Training  Plan,  Army  Subject  Schedules/POIs,  Soldier's 
Manuals  and  Commander's  Manual.  Existing  technical  manuals, 
combat  manuals,  and  job  materlals-aids. 

Training  Setting.  Per  TRADOC  Reg  350-100-1  (draft)  the  candidate 
training  settings  for  exportable,  self-paced  job  training  are 
garrison,  local,  and  major  training  areas  normally  at  battalion 
levels  or  lower.  A self-study  training  module  may  be  designed 
for  the  job  site,  a unit  learning  center,  barracks,  home,  etc. 

An  SOJT  module  is  designed  for  the  unit,  and  training  areas/ 
facilities  to  which  the  unit  has  direct  access. 

* 

"Analysis,  Development  and  Evaluation  of  Individual  Training" 
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Leadtime  and  Costs.  This  will  vary  with  the  urgency  and  the 
magnitude  of  the  analysis,  design,  and  development  efforts 
f required.  The  Individual  Training  Plan  should  provide  the  basis 

for  estimating  and  allocating  school  and  external  support 
requirements.  Funding  may  range  anywhere  from  one-quarter  million 
to  several  million  dollars  for  a given  exportable  course  require- 
ment. 

School  Support  Capability.  USAFAS  training,  design,  and  course 
developers  have  the  access  to  subject-experts  and  skills  required 
for  the  training,  analysis,  course  design,  and  course  development 
activities  needed  for  TEC  and  other  self-pacing  programs  including 
computer-assisted  instruction  (CAI) . Whether  or  not  USAFAS  has 
sufficient  manpower  to  handle  all  aspects  of  analysis,  design, 
development,  packaging,  and  production  within  funding  and  time 
constraints  will  determine  how  the  work  is  accomplished:  (1)  en- 
tirely in-house;  (2)  a joint  Army-contractor  team  at  USAFAS; 

(3)  packaging  and  production  contracted-out;  or  (A)  the  entire 
development  process  contracted-out. 

d.  Delivery  System  Solution  Factors 

The  exportable  courses  will  be  multi-media,  the  mix  selected  as 
appropriate  for  the  job-tasks  being  trained  and  the  trainees. 
Eligible  media  will  include:  audio  visual,  audio  only,  programmed 
text,  printed  pictorials,  job-aids,  or  a combination  of  these  — 
all  materials  which  can  be  packaged  and  exported  to  units  from  a 
central  source  such  as  ATSC.  Also,  unit  television  trainers  (TVT) 
allow  units  to  make  their  own  tapes  or  to  use  those  made  by  the 
TASO  at  Ft.  Sill.  Student  Study  Guides,  Student  Workbooks,  and 
Correspondence  Courses  are  also  available  for  export  from  Ft.  Sill 


or  ATSC.  Cotsputer-Assisted/Managed  instruction  is  also  a candidate 
for  access  by  units,  given  that  units  are  equipped  with  one  or 
more  interactive  terminals,  terminal  printers,  and  phone  connec- 
tions to  an  Army  centralized  computer  facility  such  as  the  Edgewood 
Arsenal  UNIVAC  1108.*  USAFAS  personnel  can  develop,  validate,  and 
update  CAI  lessons.  With  the  TACFIRE  system,  the  delivery  system 
for  computer-assisted  operator  training  and  practice  is  embedded 
in  the  system  for  export  when  the  system  is  fielded.  Other  poten- 
tially exportable  delivery  systems  include  tactical  simulation 
games  (TEWTS)  and  two-sided  engagement  simulations  such  as  REALTRAIN 
and,  in  the  future,  MILES.  Presently,  the  Observed  Fire  Panoramic 
Classroom  Simulator  at  USAFAS  shows  potential  for  export  to 
garrison-post  training  settings  having  the  required  facilities 
and  user  skills. 

With  all  these  existing  or  potential  exportable  packages,  unit 
training  management  materials  are  essential.  The  management  plan 
and  procedures  for  a given  course  should  be  specifically  tailored 
to  the  form  of  training  (SOJT,  independent  self-study),  the  training, 
setting  (job  or  system,  learning  center,  garrison-local-major 
training  areas)  and  the  particular  materials  and  delivery  systems 
used. 


See  Section  6 of  report  for  further  details  on  unit  remote  usage 
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4 . Self-Pacing  of  MOS  Course  for  Instituclonal  Use 

a.  Situation 

USAFAS  developers  are  designated  responsible  for  preparing  all 
or  portions  of  an  existing  or  projected  MOS  school  course  for 
self-paced  individual  training.  There  may  be  a requirement  to 
export  the  course  to  another  Army  Training  Center.  A recent 
example  is  the  USAFAS  self-pacing  of  the  82C  Survey  course. 

Future  priorities  could  include  FADAC  maintenance  and  operation, 

Fire  Support  Team  (FIST)  operation,  Pershing  repair,  SR-56  operation, 
and  Artillery  Officer  Basic  Course. 

b.  Selection  Factor  Impacts 

Trainee  Characteristics.  Same  as  Situation  3,  except  that  this 
could  be  focused  more  on  Senior  NCOs  (e.g.,  skill  levels  5-9)  and 
Officer  Basic/Advanced  OPMS  levels. 

Individual-Collective  Tasks.  Same  as  Situation  3,  except  that 
NCO  leadership,  training,  training  management  and  new  or  specialized 
skills  where  USAFAS  offers  unique  capabilities  such  as  use  of 
automated  maintenance  gear  or  specialized  intercultural  language 
learning,  may  be  the  main  focus.  Similarly,  officer  platoon 
leader,  organizational  effectiveness,  and  CPX  tactical  decision- 
making training  may  be  best  for  the  school  situation. 

c.  Constraint  Factor  Impacts 

Primary  Regulatory  Directives.  Same  as  Situation  3. 


Primary  Source  Data.  Same  as  Situation  3 
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Training  Setting*  Facilities  of  USAFAS  and/or  an  Army  Training 
Center. 

Leadtime  and  Costs.  Same  as  Situation  3,  except  that  funding  may 
be  applied  to  accomplish  the  work  entirely  within  USAFAS.  Examples 
where  such  work  has  been  contracted-out  Include  work  at  the 
Ft.  Eustls  Transportation  School  to  develop  three  self-paced 
technical  courses  for  helicopter  maintenance  and  three  for  water 
craft  technicians;  the  440  thousand  dollar  contract  Including  a 
soldier  validation  of  learning  requirement. 

School  Support  Capability.  Same  as  Situation  3,  except  that  the 
broader  range  of  usable  delivery  systems  In  USAFAS  and  Army 
Training  Centers  and  concommltant  need  for  materials  development 
and  update  may  place  a burden  for  more  flexible  skills  on  USAFAS 
course  designers  and  developers.  It  may  also  become  more  taxing 
on  the  USAFAS  training  resource  managers  to  Identify  appropriate 
manpower  skills  across  the  school  and  combine  them  Into  the  teams 
required  for  a particular  development  (e.g.,  combining  scenario 
d^elopment  and  training  management  skills  for  the  Fire  Control 
Simulator  BT-33  with  skills  needed  for  development  of  other  media). 
Support  of  the  Ft.  Sill  TASO  Is  available. 

d.  Delivery  System  Solution  Impacts 

Eligible  delivery  systems  Include  all  of  those  listed  for 
Situation  3,  plus  the  other  training  and  evaluation  resources 
available  at  USAFAS  such  as  the  Fire  Control  Simulator  BT-33, 
Artillery  Direct  Fire  Trainer,  M31  Field  Artillery  Trainer,  CPX 
simulation  facility,  language  learning  centers,  and  both 
mobile  and  classroom  television  facilities.  The  co-located 
TASO  may  be  able  to  design  and  produce  relatively  simple  mock-ups. 
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simulations,  and  training  devices  which  are  low-cost,  require 
little  research  and  development,  can  utilize  OMAP-8  funds,  and 
require  short  leadtime.  If  the  USAFAS  self-paced  course  is 
also  intended  for  export  to  an  Army  Training  Center,  this  may 
influence  the  candidate  delivery  systems. 

Update  of  Fielded  ITDT/MOS  Packages 

a.  Situation 

Once  fielded,  ITDT  and  MOS  materials  will  undergo  continuing 
evaluation  to  ensure  continuing  adequacy  with  respect  to  user 
needs.  Field  users,  combat  developers,  or  evaluators  may  determine 
that  technical  or  tactical  doctrine  is  no  longer  appropriate 
and  must  be  adjusted.  A new  technological  development  in  systems 
or  jobs  changes  performance  requirements.  Inconsistencies  are 
found  between  the  field  documentation  and  the  training  support 
package.  Any  of  these  situations  can  cause  a requirement  to 
update  fielded  manuals  (combat,  technical,  training)  and/or  the 
training  and  evaluation  materials. 

b.  Selection  Factor  Impacts 

Trainee  Characteristics.  No  Impact  in  particular,  unless  changing 
characteristics  or  capabilities  of  the  job  trainee  pool  are  the 
cause  for  update;  for  example,  materials  once  intelligible  to  the 
job  incumbents  are  no  longer  so,  or  the  ability  levels  of  job  in- 
cumbents have  increased  to  the  point  where  the  materials  are  too 
didactic . 

Individual-Collective  Tasks.  Prior  front-end  job  task  analysis  . 
data  must  be  assessed  to  determine  the  required  changes  in  indi- 
vidual skills,  team  interactions,  tools,  references,  standards , etc . , 
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caused  by  the  changes.  A clear,  accessible  audit  trail  of  tasks, 
subtasks,  and  task  hierarchy  or  relationships  will  ease  identifying 
change  impacts.  This  is  currently  a manual  data  and  configuration 
control  operation  in  service  schools.  Implementation  of  the 
Training  Development  Information  System  (TDIS)  by  Training 
Developments  Institute  (TDI)  and  ATSC  in  the  near  future  may 
provide  automated  remote  access  assistance  to  USAFAS  for  this 
problem. 

Constraint  Factor  Impacts 

Primary  Regulatory  Directives.  FM  100-5,  TRADOC  Reg  350-100-1, 
Chapters  7 and  8 (draft),  AR611-3  on  job  task  analysis,  and  all 
others  referenced  for  Situations  1 through  4 as  appropriate  to 
the  update  change  requirements. 

Primary  Source  Data.  Questionnaire  replies  or  change  requests 
input  from  field  users  to  Army  Training  Board,  ATSC,  or  the 
proponent  school,  USAFAS.  Configuration  management  and  change 
control  inputs  designed  for  the  object  system.  Field  and  force 
test  reports.  Activities  and  findings  from  the  USAFAS  Director 
of  Evaluation.  Individual/Collective  Training  Plans. 

Training  Setting.  Any  of  those  mentioned  for  Situations  1-4, 
as  appropriate  to  the  change  requirement. 

Leadtime  and  Costs.  It  is  highly  desirable  to  minimize  the  costs 
and  maximize  the  efficiency  associated  with  determining  require- 
ments for  updating  and  providing  the  follow-up  changes  to  units. 
There  are  significant  variations  in  update  efficiency  and  costs 
among  the  various  media. 
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School  Support  Capability.  A major  problem  in  updating  documen-  | 

ration  and  training  materials  is  in  locating  all  the  areas  in  | 

which  the  change  must  be  reflected.  As  a rule,  any  deficiency  ■ 

which  requires  a change  in  the  fielded  materials  should  also 
be  reflected  in  appropriate  intermediate  products  to  provide  ■ 

currency  of  the  data  base  audit  trail.  The  delivery  system 
and  supporting  material  decisions  recorded  on  an  expanded  job- 
duty  task  matrix  and  maintained  as  part  of  the  Individual/ 

Collective  Training  Plan  will  materially  assist  this  effort. 

d.  Delivery  System  Solution  Impacts 

Delivery  system  decisions  shou] d consider  the  storage  media 
permitting  efficient  and  least  costly  updates.  For  example,  the 
cost  of  on]  -f  the  studio  production  portion  of  a normal  TV  tape 
at  USAFAS  has  been  stimated  at  $300/minute. * Conversely,  a CAI 
system  such  as  P!  Ai.  T which  is  in  use  by  USAFAS,  contains  an 
interactive  compiler  such  that  changes  input  to  computer-stored 
lessons  from  the  keyboard  are  made  instantaneously  and  can  imme- 
diately be  administered  for  checking  or  to  students.  Similarly, 
it  is  more  efficient  for  USAFAS  to  update  slides  for  a Singer 
Caramate  than  to  update  audio-filmstrips  for  the  Beseler  Cue-See 
device. 

In  some  cases  it  may  make  sense  to  have  a training  delivery 
system  separate  from  the  course  developer's  updating  system 
t I to  make  update  of  manuals  and  training  materials  more  efficient. 

For  example,  script  production  is  normally  carried  out  as  part 
of  the  development  process  for  a variety  of  delivery  systems  — « 

[ audiovisual,  audio-only,  slides,  technical  and  combat  manuals. 


^personal  communication  at  USAFAS 
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videotapes,  simulator  positions,  etc.  This  printed  material 
could  be  input  and  formatted  as  part  of  the  development  process 
using  an  efficient  computer-based  text  editor,  such  as  that 
recently  used  and  accessible  from  USAFAS  on  the  UNIVAC  1108  at 
Edgewood  Arsenal.  Stored  in  this  form,  update  is  immediate  and 
not  costly.  Listings  can  be  rapidly  produced  to  serve  as  nar- 
ration scripts  for  visual  and/or  audio  productions,  or  for 
simulation  exercise  player  inputs. 
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SECTION  4.  PRELIMINARY  DELIVERY  SYSTEMS  SELECTION  PROCESS 

Section  3 identified  the  primary  selection,  solution,  and  constraint  factors 
influencing  delivery  system  decisions  for  a training  program  and  contrasted 
several  instructional  development  situations  predicted  for  USAFAS  during 
FY  78-83  on  these  decision  factors. 

This  section  first  suggests  criteria  to  guide  the  design  and  subsequent 
evaluation  of  a delivery  system  selection  process  useful  to  USAFAS  during 
FY  78-83.  Then,  a delivery  system  selection  process  is  presented  that  takes 
into  account  the  decision  factors  identified  in  Section  3 in  a sequence  of 
four  decision  stages  keyed  to  the  events  and  products  of  a materiel  system  . 
and/or  MOS  life-cycle  proponency  timeline.  The  kinds  of  delivery  system 
decisions  appropriate  to  source  data  available  at  successive  events  is  indicated. 
How  the  successive  decision  stages  build  upon  each  other  and  serve  as  input 
to  an  evolving  Individual-Collective  Training  and  Evaluation  Plan  is  shown. 

A.  CRITERU  FOR  EVALUATION  OF  PROCESS 

Based  upon  the  frame  of  reference  provided  in  earlier  sections,  the  nine 
criteria  described  below  have  guided  the  design  of  a preliminary  delivery 
systems  selection  model  for  the  USAFAS  training  support  situations  anticipated 
during  FY  78-83.  Given  a suitable  data  collection  plan,  these  criteria  may 
also  be  applied  in  evaluating  the  utility  and  outcomes  of  applying  the  process 
during  subsequent  developmental  work  suggested  in  Section  6. 

1.  Method  Useful  to  USAFAS  Training  Programs  Development 

For  the  delivery  system  process  to  be  useful  to  USAFAS,  it  should  be 
compatible  with  existing  ISO  guidance  and  practice  at  USAFAS  but — more 
Important  for  the  FY  78-83  period — should  be  attuned  to  changing  roles 
and  responsibilities  of  TRADOC/DA  groups,  trends  in  delivery  system 
developments,  and  Army  regulatory  directives  and  guidance  emerging 


4-2 


for  FY  78-83.  These  directives  and  guidance  include:  ITDT  process  and 
Mil  Specs;  AR  1000-2  (draft),  TRADOC  Reg  350-100-1  (draft),  TC  351-3 
(under  revision);  TC  21-5-7  and  FM  21-6  for  unit  training;  and  the 
methods  of  TRADOC  Pam  71-10  (with  TRADOC  Reg  11-8  and  TRADOC  Pam  71-8) 
currently  suggested  as  the  authoritative  guide  in  the  planning,  conduct, 
and  review  of  TRADOC  cost  and  training  effectiveness  analyses  (CTEA) . 
These  initiatives  have  received  emphasis  in  the  framework  already 
provided  by  Sections  2 and  3 of  this  report.  The  delivery  system 
decision  process  described  in  this  section  builds  upon  this  framework. 

2.  Takes  Into  Account  Readily  Available  Characteristics  of  Trainees 

The  delivery  system  selection  process  should  make  use  of  that 
available  data  on  trainees  which  is  useful  to  successive  decisions  on 
delivery  systems  within  the  phases  and  events  of  an  overall  USAFAS 
system/MOS  life-cycle  proponency  responsibility.  Depending  on  the 
phase,  the  trainee  characteristics  data  considered  should  be  available 
from  such  sources  as:  (1)  DA/DCSPER;  MILPERCEN,  and  SIDPERS  data 
files;  (2)”  instruments  administered  during  validation,  verification, 
developmental-operational  tests,  user  field  tests,  or  training  imple- 
mentation; (3)  school  or  unit  personnel  records;  and  (4)  job  training 
survey  data  obtained  from  job  incumbents  and  their  supervisors. 

3.  Considers  Capabilities  and  Constraints  of  Job-Training  Settings 

There  is  a strong  interaction  between  selection  of  training  setting  and 
choice  or  configuration  of  delivery  systems  for  training  and  evaluation. 
The  delivery  system  selection  model  should  take  into  account  the 
resources  and  constraints  of  the  various  eligible  training  settings: 

(1)  in  system-on  job;  (2)  garrison,  local,  and  major  training  areas; 

(3)  unit  learning  center;  and  (4)  other  unit  area,  barracks,  or  home. 

It  should  also  take  into  account  the  resources  and  constraints  of  Army 
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training  institution  . (USAFAS,  training/education  centers,  NCO 
academics,  post  installation  schools,  Reserve  and  National  Guard 
schools,  etc.)-* 

4 . Considers  Characteristics  of  Individual-Collective  Job  Duties  and  Tasks 

Behavioral  performance  requirements  for  progressive  levels  of  individual, 
group,  and  collective  team  skills  define  the  training  subject  matter 
and  must  be  a prime  selection  factor  in  making  delivery  system  decisions. 
Once  critical  tasks  have  been  selected  for  training,  selecting  or 
configuring  an  optimal  delivery  systems  mix  should  consider  such  job- 
dut’  task  characteristics  as:  (1)  realistic  situational  cues  and 
responses;  (2)  tools,  equipment,  and  references  employed;  (3)  skill 
and  competency  groupings  of  tasks  by  job  duty;  ''4)  duty  and  task  per- 
formance measures  and  standards;  (5)  logical  training  progression  for 
individual,  group,  and  team  behaviors;  and  (6)  requirements  for  skill 
acquisition  and  sustaining  practice. 

5.  Takes  Into  Account  Job  Training  Resources  Existing  in  Units  and  School 

The  delivery  system  selection  process  for  a training  and  evaluation 
program  should  utilize  or  adapt  to  the  maximum  extent  possible,  con- 
sistent with  other  problems  or  requirements,  those  delivery  systems  and 
training  support  materials  already  existing  in  the  selected  job-training 
settings — system  or  job,  unit  area,  and/or  school.  For  example,  SQTs, 
ARTEP,  soldier  manuals,  combat  literature,  job  manuals  and  job-aids, 

TEC  packages,  training  literature,  correspondence  courses,  TV  video- 
tapes, standard  briefing  aids  (maps,  charts,  overlays,  vu-graphs), 
and  actual  equipment  or  mockups  that  may  be  available  in  unit 
training  settings. 


See  TRADOC  Reg  350-100-1  (March  1977  draft) . Those  eligible  training  settings 
are  not  in  direct  correspondence  to  the  settings  suggested  in  the  ISD  model, 
TRADOC  Pam  350-30. 
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6.  Takes  Into  Account  Pocentially  Exportable  School  and  TRADOC  Resources 

The  delivery  system  selection  process  for  a training  and  evaluation 
program  should  consider  supplementing  or  replacing  existing  unit 
resources  with  those  considered  more  effective  for  the  settings,  levels 
of  training  objectives,  and  practice  requirements  emerging  from  needs 
and  job-duty  analyses.  Candidates  for  export  or  unit  access  may 
include  tactical  games,  system-embedded  trainers  (devices/software), 
and  battle  engagement  simulations. 

7 . Outputs  of  Process  Useful  to  USAFAS  Developers 

The  delivery  systems  selection  process  should  result  in  decisions 
which  can  be  supported  by  USAJ.^S  developers  and  operations  training 
supervisors.  "Support"  includes  access  to  development  facilities  and 
the  manpower  skills  required  to  develop  and  update  training  materials 
for  unit  exportable  or  accessible  training.  Support  may  require  the 
ability  to  specify  delivery  system,  design,  and  development  require- 
ments including  product  standards  for  contracted  SOW/procurement 
packages;  then  to  monitor  work  progress  and  evaluate  products. 

8 . Delivery  System  Products  for  USAFAS  are  Usable  by  Units 

The  delivery  systems  process  should  result  in  decisions  usable  by 
unit  training  supervisors.  This  implies  that  delivery  systems  and 
training  materials,  whether  exported  to  or  remotely  accessed  by  units, 
should  include  training  management  guides  for  students  and  for  job 
supervisors  or  training  NCOs  which  proceduralize  training  management. 
Further,  these  guides  should  be  appropriate  to  the  training  settings 
chosen  for  the  delivery  systems.  The  adequacy  of  these  guides  and 
procedures  should  be  assessed  during  large-group  validation,  opera- 
tional testing,  and  after  field  or  school  implementation. 
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9 . Delivery  System  Products  Result  In  Effective,  Efficient,  Acceptable 
Training 

The  selected  delivery  systems  and  support  packages  resulting  from 
development  should  result  in  effective  trainee  individual  job-duty 
and  collective  mission  proficiency  as  evidenced  by  packaged  perfor- 
mance tests,  SQT  (written,  hands-on,  certification  components)  and 
ARTEPs.  Efficiency  should  be  evidenced  by  data  gathered  during 
validation,  operational  tests,  and  implementation  usage  in  school  and 
field,  such  as;  time  to  mastery,  trainee  loads  and  frequency,  number 
of  supervisors/instructors , supervisor /student  ratios,  and  instructor 
contact  hours.  Acceptance  of  the  training  media  and  methods  should 
be  evidenced  by  attitude  questionnaires  administered  to  subject 
experts,  trainees,  and  training  supervisors  during  development  and 
implementation  usage. 

B.  PRELIMINARY  DECISION  PROCESS  AND  PRODUCTS 

The  delivery  systems  selection  process  described  below  incorporates  the 
frame  of  reference  provided  in  Sections  2 and  3,  and  is  intended  to  satisfy 
the  design  criteria  described  above. 

Figure  4-1*  shows  a system  and  training  development  program  life-cycle, 
highlighting  four  primary  delivery  system  decision  stages  with  associated 
inputs  and  technical  or  management  products.  Key  orientation  to  Figure  4-1 
is  as  follows: 

• The  major  phases  of  system  development  including  developmental- 
operational  tests  are  labeled  at  the  top,  with  concurrent  training 
development  phases  directly  underneath.  The  phases  shown  are 
compatible  with  the  Army  Life  Cycle  System  Management  Model  (LCSMM) 
and  emerging  Total  Systems  Management  directives  (AR  1000-2  impact) 
in  that:  (1)  combat  developer,  training  developer,  and  materiel 


*Figure  4-1,  an  apron  foldout  on  page  4-17,  can  be  extended  to  assist  reader 
orientation. 
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developer  inputs  are  integrated  in  the  events;  (2)  Low-Rate  Initial 
Production  preceding  production  decision  is  eliminated;  and  (3) 
DT/OT-III  or  other  type  of  user  field  test  is  shown  as  an  ASARC 
option,  to  lower  the  life-cycle  system  costs  and  expedite  fielding 
of  the  system. 

• The  training  development  phases,  activities,  and  products  are 
generally  compatible  with  ITDT,  ISD,  and  TEC  procurement  guidance 
suitable  both  for  a system-job  duty  orientation  and  an  EPMS/OPMS 
specialty  focus. 

• The  process  activities  and  products  show  outputs  of  the  initial 
requirements  and  front-end  analysis  events  driving:  first , the  design 
requirements  for  combat,  MOS,  and  mission/task  evaluation  materials 
(How-to-Fight  manuals,  ARTEP,  SQTs,  Soldier's  Manuals,  Commander's 
Manual)  and;  second,  the  design  of  technical  manuals,  job-aids, 

and  training  support  methods,  media  and  materials.  This  is  to 
encourage  the  "crosswalk"  integration  of  individual-collective  task 
and  mission  performance  requirements  with  training  and  evaluation 
developments,  including  the  compatible  selection  of  delivery  systems 
for  evaluation  and  training. 

• Four  delivery  system  decision  stages  are  highlighted  to  show  the 
types  of  decisions  that  are  appropriate  to  each  stage,  based  upon 
the  available  data,  work  activities,  and  interim  products  of  each 
system  or  training  development  phase. 

• An  Individual /Co 11 active  Training  and  Evaluation  Plan  (ICTE?)  is 
shown  as  an  evolving  product  for  management  of  technical  developments 
throughout  the  system  and/or  MOS  training  propency  life-cycle.  It 
identifies  the  specific  MOS,  skill  levels,  and  jobs  (operator/crew. 


maintenance,  unit  support)  to  be  trained  as  well  as  delivery  system 
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decisions.  Such  a plan  is  to  be  produced  by  the  proponent  school  or 
TRADOC  system  manager  representing  field  users.  It  becomes  the 
training  proponency  game-plan  and  should  summarize  job,  task,  setting, 
trainee,  and  delivery  systems'  decisions  and  data  against  which  time, 
financial,  and  manpower  resources  for  development  are  allocated  and 
audited . * 

1.  Stage  1 - State  Delivery  System  Requirements  and  Preliminary  Candidates 

Process;  Initially  a requirement  for  system,  job,  or  MOS  needs  is  generated 
by  field  forces,  combat  developers.  Army  testing  agencies,  or  other  sources. 
TRADOC/DARCOM  combat,  training,  and  materiel  developers  work  together  to 
determine  system  operations  and  hardware  functional  design,  employment 
concept,  maintenance  and  logistic  support  concept,  personnel  subsystem 
information  and  requirements,  and  training  support  concept.  Personnel 
subsystem  concept  should  result  in  decisions  on:  (1)  jobs  and  duty  positions; 
(2)  job  locations  and  density;  (3)  relation  of  system-job  duties  to  EPMS/ 

OPMS  specialty  skill-level  structure;  (4)  manning  transition  requirements 
from  testing  to  IOC  and  subsequent  deployment;  (5)  determining  needs  for 
new  specialty  shred-outs  or  cross-training;  and  (6)  determining  the  major 
Army  doctrine,  directives,  and  specifications  governing  developments. 

From  this,  training  needs  and  requirements  are  generated. 

Data  Sources;  DCSPER,  MILPERCEN,  and  SIDPERS  data  banks  as  well  as  data 
from  Army  testing  agencies  and  job  surveys  are  used  to  generate  personnel 
subsystem  requirements  information,  or  QQPRI  (Quantitative  and  Qualitative 
Personnel  Requirements  Information)  to  guide  training  program  requirements, 
initial  selection  of  candidate  delivery  systems,  and  subsequent  front-end 
analysis  work. 

Delivery  System  Decisions.  The  major  emphasis  at  this  stage  is  to  use 
personnel  requirements  information  data  and  training  requirements  to 

Joint  TRADOC/DARCOM  Letter,  "Integrated  Technical  Documentation  and  Training 
(ITDT)  for  Development  Systems,"  (April  1977  (Draft).  TRADOC  Reg  350-100-1, 
"Development,  Implementation  and  Evaluation  of  Individual  Training,"  March  1977 
(Draft). 


arrive  at  a training  concept  covering  needs,  settings,  loads,  frequency, 
delivery  systems,  and  anticipated  results.  For  delivery  systems,  the  major 
goal  is  to  state  constraints  and  performance  expectations,  and  make  pre- 
liminary decisions  on  candidates.  Examples  of  requirements  statements 
include  the  following: 

• "All  delivery  systems  must  be  available,  or  readily  exportable,  to 
field  units  with  no  special  impacts  upon  operational  equipment." 

• "Training  delivery  systems  and  SQT/ARTEP  delivery  systems  must  be 
compatible  and  realistic  for  combat  performance  requirements." 

• "The  training  program  and  delivery  systems  used  must  reduce  the  overall 
life-cycle  cost  of  the  proponent  school  training  program." 

• "Training  approaches  and  devices  shall  be  designed  for  a combined 
pictorial-verbal  intelligibility  and  comprehension  level  of 
grade  school." 

• "Training  approaches  and  devices  shall  be  compatible  with  ITDT  Mil 
Specs  and  the  DA  Technical  Documentation  and  Training  Acquisition 
Handbook. " 

Such  statements  serve  as  constraints  or  specifications  within  which  initial 
delivery  system  categories  are  selected;  for  example,  exportable  audiovisual 
and  print,  as  well  as  system-embedded  hardware  or  software  simulation  techniques 
may  be  candidates  for  the  requirements  stated  above.  Assessment  of  supporting 
technology  for  the  candidate  delivery  systems  against  constraints  and  require- 
ments may  reveal  a need  for  further  development;  as  with  a major  training 
device.  This,  in  turn,  may  require  that  a preliminary  Cost  and  Training 
Effectiveness  Analysis  (CTEA)  be  performed  to  assess  tradeoffs  and  provide 
decision  rationale  for  the  Individual/Collective  Training  and  Evaluation  Plan. 


Outputs;  Initial  decisions  on  jobs,  MOS,  manning,  and  other  personnel 
subsystem  requirements,  as  well  as  the  training  concept  and  candidate  delivery 
systems  are  entered  into  a draft  Individual/Collective  Training  and  Evaluation 
Plan  (ICTEP) . This  states  preliminary  requirements  and  is  an  important  start 
on  integrating  system,  job,  MOS,  evaluation,  and  training  requirements.  For 
a system  acquisition  program,  the  ICTEP  also  serves  as  an  Outline  Training 
Development  Plan  for  input  to  the  Outline  Development  Plan  (ODP)  for  the 
materiel  system. 

2.  Stage  2 - Select  Major  Delivery  Systems  Mix  for  Training  Program 

Process:  The  development  of  combat  and  technical  documentation,  MOS-oriented 
training  literature, ^ associated  evaluation  materials,  and  supportive  training 
should  be  based  on  a common  foundation  of  precisely  defined  individual- 
collective  job  performance  requirements  data.  These  data  are  developed 
through  a process  commonly  referred  to  as  a front-end  analysis  (FEA).* 

FEA  entails  systematic  data  collection,  analysis,  and  decision  making  to 
provide  the  basic  data  and  associated  documentation  and  training  delivery 
system  decisions  needed  for  designing  and  developing  manuals,  job-aids, 
evaluation,  and  training  materials  as  an  integrated  package.  Analysis  of 
operator  and  staff  tactical  mission  functions  as  well  as  equipment-oriented 
operator/crew  and  maintenance  functions  results  in  matrices  associating  job 
tasks  with  duty  positions  and  with  equipment.  Task  data  worksheets  are 
then  prepared  for  individual  and  collective  job  tasks.  These  are  then 
analyzed  to  identify  task  competencies,  select  representative  competencies 
and  critical  task  sequences,  and  prepare  a consolidated  list  of  competencies 
for  each  job.  The  resulting  matrix  associating  critical  individual-collective 
competencies  with  job  duty  positions  can  then  drive  critical  task  selection 
for  Commander's  Manuals,  ARTEPs,  SQTs,  and  Soldier's  Manuals — as  well  as 
providing  input  to  Stage-2  delivery  system  decisions. 


*In  a major  acquisition,  FEA  will  progress  concurrently  with  system  concept 
validation,  following  an  Army  program  initiation  decision  and  appointment  of  a 
DARCOM  Program  Manager  (PM)  and  TRADOC  System  Manager  (TSM) . 
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Source  Data:  The  primary  source  data  for  delivery  system  C cisions  at 
this  stage  will  include:  (1)  results  of  functional,  task,  and  competency 
analyses  from  above;  (2)  experiential  data  or  aptitude-ability  data  for 
personnel  participating  in  DT/OT-I;  (2)  performance  results  of  DT/OT-I; 

(3)  existing  training  and  evaluation  resources;  (4)  any  results  from 
feasibility  and  cost  assessments  of  training  device  requirements;  and  (5) 
requirements  stated  in  the  draft  ICTEP  from  Stage  1. 

Delivery  System  Decisions:  The  matrix  associating  individual-collective 
performance  competencies  with  job  duties,  the  selection  of  critical  training 
tasks,  and  other  source  data  noted  above  is  used  to  decide  on  the  major 
types  of  devices  and  materials  for  the  program  job,  training,  and  evaluation 
requirements.  Two  critical  factors  for  this  decision  are:  (1)  initial 
selection  of  work-training  settings  in  the  Stage-1  ICTEP;  and  (2)  the  levels 
of  individual-collective  competencies  to  be  trained;  e.g.,  individual 
equipment  skills,  individual  tactical  skills,  operator-supervisor  coordi- 
nation, operator-external  coordination,  command  staff,  etc.,  resulting 
from  front-end  analysis. 

Stage-2  decisions  result  in  two  candidate  lists:  existing  delivery  systems 
f selected,  and  selection  of  potentially  available  delivery  systems  requiring 

development.  .For  example,  the  existing  materials  could  Include  tools,  test 
gear,  FMs,  combat  literature,  and  TEC  packets.  The  developmental  delivery 
systems  might  Include  simplified  and  intelligible  technical  manuals, 
computer-mediated  training  support,  and  command  or  engagement  simulations. 

Outputs : The  Stage  2 decisions  on  delivery  systems,  with  supporting  rationale 
for  the  overall  mix  selected  for  the  training  program,  is  used  to  detail 
the  Individual/Collective  Training  and  Evaluation  Plan  (ICTEP)  in  Stage  1. 

This  may  include  data  resulting  from  a mlnl-CTEA  or  full  CTEA  (TRADOC 
Reg  11-8)  conducted  during  this  phase.  At  this  point,  the  ICTEP  becomes 
a baseline  record  of  technical  decisions  with  supporting  justification 
to:  (1)  ensure  integration  of  component  products  and  standards;  (2)  gauge 
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estimates  of  school  and  external  resources  required  (time,  manpower,  money, 
facilities);  and  (3)  provide  an  audit  trail  for  change  control  or  upward 
reporting.  It  also  provides  TRALOC  input  to  the  materiel  system  Develop- 
ment Plan  (DP) . 

Appendix  A-1  contains  an  example  of  the  selection  rationale  supporting  a 
delivery  systems  mix  for  the  TACFIRE  advanced  training  program  at  USAFAS. 
Appendix  A-3  is  an  example  of  a mini-CTEA  generated  in  support  of  the  pro- 
posed mix. 


3.  Stage  3 - Configure  Delivery  Systems  for  Specific  Performance  Modules  and 
Lessons 

Design  Process;  This  training  design  phase  utilizes  outputs  of  the  front- 
end  analysis  and,  in  fact,  may  be  an  unbroken  part  of  FEA  leading  up  to 
development  decisions  for  a particular  program.  For  a system  acquisition, 
documentation  and  training  design-development  will  parallel  the  materiel 
system  Engineering  Development  phase  leading  up  to  DT/OT-II.  First, 
behavioral  task  analysis  details  the  individual-collective  tasks  selected 
during  FEA  into  subtasks.  The  responses  required  to  achieve  the  behavioral 
competency  of  each  subtask,  and  the  situational  cues  that  guide  the 
response  are  identified.  Together,  this  data  indicates  the  primary  sensory 
modalities  and  active  responses  required  by  the  collection  of  tasks 
defining  each  job  duty.  The  outcomes  of  behavioral  task  analysis  lead 
directly  to  development  of  storyboards  for  draft  technical  manuals  and  to 
preparation  of  job  performance  measures  (tests  and  standards).  Criterion 
and  enabling  training  objectives  derived  from  the  task-subtask  sequences 
are  prepared.  These  objectives  are  then  grouped  into  lessons  and  sequenced 
into  performance  modules.  The  result  is  a matrix  associating  training 
performance  modules  and  lessons  with  job-duty  positions.*  Another  important 

*Page  A-21  shows  an  example  of  a matrix  associating  tactical  system  duty 
positions  at  several  echelon  levels  with  a number  of  performance  modules  for 
three  functional  areas  (formats,  equipment,  and  procedures) . It  served  as  a 
baseline  for  the  CTEA  estimates  also  contained  in  Appendix  A-3. 
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decision  finalized  at  this  stage  is  the  training  setting  for  each  perfor- 
mance nodule.  Current  guidance  suggests  candidate  settings  as:  (1) 
system-embedded,  (2)  SOJT;  (3)  self-study;  (4)  garrison,  local,  or  major 
training  areas;  and  (4)  institutional. 

Source  Data:  The  task  data,  performance  measures,  lessons  list,  job  duty/ 
performance  module  matrix,  and  training  setting  decisions  from  the  design 
process  are  the  primary  data  influencing  Stage-3  delivery  system  decisions. 
Another  source  is  the  soldier  profile  and  performance  data  obtained  from 
DT/OT-I  (for  training  associated  with  system  procurement)  and  used  to  up- 
date the  ICTEP  based  upon  the  results  of  DT/OT-I.  Job  survey  data  including 
CODAP,  Army  data  files  (e.g.,  GT  and  .ACB  subtest  data),  and  Army  field 
evaluation  and  user  support  agencies  (e.g.,  Army  Training  Board,  MASSTER) 
may  be  useful  sources  of  soldier  data  prior  to  actual  data  obtained  during 
small-group  and  large-group  validation. 

Delivery  System  Decisions:  The  Stage  3 focus  is  to  select  the  specific 
type  and  mix  of  delivery  systems  for  each  performance  module.  This  is 
based  on  the  individual-collective  training  and  evaluation  requirements 
of  the  module,  the  training  setting,  and  available  soldier  data  that  is 
useful.  Similarly,  the  specific  method-media  for  each  lesson  is  selected. 
Both  the  performance  module  and  lesson  level  decisions  must  consider  the 
requirement  for  demonstration,  situational  displays,  active  responses, 
drill,  evaluation,  and  sustaining  practice.  These  considerations  will 
usually  lead  to  compatibility  of  methods-media  mix  for  lessons  within  a per- 
formance module. 

Another  consideration  at  this  stage  is  the  feasibility  and  desirability  of 
providing  alternative  delivery  systems  for  the  same  training  objectives. 

This  may  be  desirable  if  there  is  evidence  that  trainee  abilities, 
cognitive-perceptual  style,  or  preferences  will  vary  substantially.  How- 
ever, such  evidence  may  not  be  available  until  after  large-group  validation, 
verification,  or  DT/OT-II.  Training  setting,  cost,  and  other  constraints 
may  limit  feasibility. 
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Design  Outputs:  The  primary  Stage-3  outputs  driving  development  activities 
are  the  task  data,  performance  measures,  lessons  list,  job-duty/performance 
module  matrix,  and  Lesson  Design  Approach  (LOA)  documents.  Each  LDA  specifies 
exactly  how  the  learning  objectives  for  that  lesson  will  be  achieved.  The 
LDA  will  typically  include: 

• Lesson  Identification:  title  and  number. 

« Lesson  Relationship:  relationship  to  other  lessons. 

• Lesson  Strategy:  how  the  lesson  will  be  developed  (an  overview  of 
the  lesson  stating  what  the  soldier  will  be  taught,  lesson  pre- 
requisites, sequence  for  achieving  each  learning  objective,  instruc- 
tional method,  and  presentation  media) . 

e Lesson  Outline:  topic  headings  and  training  objectives  supported  by 
each. 

• Pre  and  Post  Test:  recommended  tests  for  validating/verifying  the 
lesson  and  measuring  student  attainment  of  learning  objectives. 

• Administrative  Requirements:  needed  to  support  the  lesson  (equip- 
ment, materials,  etc.) 

• Utilization  Rationale:  how  lesson  design  fits  with  normal  unit  work/ 
training  cycles  and  with  soldier  progression. 

Examples  of  LDAs  for  audiovisual  and  CAI  lessons  are  shown  in  Appendix  A-2. 

Development  Process:  Based  on  the  defined  LDAs  and  the  overall  performance 
module  requirements,  the  training  and  evaluation  materials  supporting  the 
entire  system-job/MOS  performance  package  are  prepared  for  the  selected 
delivery  system(s) 
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The  training  and  evaluation  management  guides  (student  guide,  training 
supervisor  guide,  lesson  administrative  instructions,  test  administration 
booklets,  progress  charts,  etc.)  are  very  important  to  utilizing  the  media. 
This  will  be  especially  true  if  alternative  methods-media  for  the  same 
objectives  are  selected  and  configured  for  trainee  preference  or  assignment. 

The  training  and  evaluation  materials  are  then  validated  in  a sequential 
manner  through  tests  involving  successively  larger  groups  of  soldiers 
representative  of  the  target  population — leading  up  to  government,  verifi- 
cation and/or  DT/OT-II  for  system  oriented  products.  During  these  stages, 
data  is  gathered  on  training  effectiveness,  efficiency,  costs,  management 
utilization,  and  acceptance  by  trainees  and  training  supervisors.  In 
addition,  experiential  questionnaires,  observational  records,  and  other 
instruments  assessing  preference  or  learning  style  may  be  administered  as 
part  of  the  training  management  sequence. 

Development  Decision  and  Outputs:  Based  upon  validation,  verification, 
and/or  DT/OT-II  results — including  the  trainee  characteristics  data 
mentioned  above — decisions  are  finalized  for  the  optimal  mix,  assignment, 
and  utilization  of  delivery  systems.  Training  management  ’plans  are 
revised  in  accordance  with  these  decisions.  This  leads  to  another  update 
and  detailing  of  the  ICTEP  baseline  plan  in  accordance  with  developmental 
acceptance  requirements,  and  prior  to  production  and  fielding  of  the  total 
system/MOS  support  package. 

4.  Stage  4 - Assign  Alternatives  During  Implementation 

Process;  Once  the  system/MOS  support  package  is  implemented  in  the  training 
setting,  training  and  evaluation  are  conducted  in  accordance  with  manage- 
ment plans  tailored  to  the  training  settings  and  delivery  system  methods — 
media  mix.  The  burden  for  effective  utilization  should  be  carried  by  a 
designed  combination  of  student  guide,  supervisor  guide,  and  management 
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instructions  within  the  media  materials — for  example,  self-evaluation  sheets 
with  prescriptive  assignments;  or  assignment  of  alternative  activities 
based  upon  automated  module  pretest  and  post  test  records  in  a computer- 
based  mode.  The  total  training  and  evaluation  job  support  package.  Including 
delivery  system  and  management  methods,  should  contain  procedures  for 
obtaining  and  recording  data  on  the  success  of  training  in  support  of 
individual  jobs  and  collective  missions. 

Source  Data;  This  will  include  all  questionnaires,  forms,  logs,  automated 
records,  videotape  records,  supervisor  reports,  training  NCO  reports,  SOT 
data.  Job  Book  records,  and  ARTEP  records  specified  for  the  Individual- 
Collective  Training  and  Evaluation  Plan  in  Stage  3;  and  implemented  in 
accordance  with  the  training  management  methods  discussed  above. 

Delivery  System  Decisions;  Stage  4 delivery  system  decisions  deal  primarily 
with  assignment  or  choice  among  training  activities  and  resources,  in 
accordance  with  the  management  plan  for  the  training  setting  and  delivery 
systems.  This  may  be  a trainee  choice  based  upon  a performance  summary 
and  the  options  available,  a controlled  assignment  based  upon  monitored 
records,  or  some  combination.  A second  decision  is  on  the  effectiveness 
and  user  acceptance  of  the  delivery  system  for  supporting  job  and  mission 
performance. 

Output : The  primary  output  is  field  usage  and  effectiveness  data.  This 
may  include  surveys  of  job  Incumbents  and  job  trainees,  job  supervisors, 
and  training  NCOs;  unit  SQT,  CPX,  FTX,  and  ARTEP  results;  and  results  of 
major  combined  arms  exercises  or  contingency  missions.  The  proponent 
school  Director  of  Evaluation,  aided  by  other  Army  test  agencies  and  Army 
Training  Board,  should  assess  such  data  to  determine  impacts  on  the 
Individual -Collective  Training  and  Evaluation  Plan. 
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In  summary,  four  decision  stages  have  been  defined  for  selecting,  configuring, 
and  managing  the  assignment  of  training  and  evaluation  delivery  systems.  These 
decision  stages  are: 

Stage  1 - State  Delivery  System  Requirements  and  Preliminary  Candidates 

Stage  2 - Select  Major  Delivery  Systems  Mix  for  Training  Program 

Stage  3 - Configure  Delivery  Systems  for  Specific  Performance  Modules  and 
Lessons 

Stage  4 - Assign  Alternatives  During  Implementation 

The  Individual/Collective  Training  and  Evaluation  Plan  (ICTEP)  is  considered 
a key  tool  for  integrating  technical  requirements,  developments,  and  school 
resources  in  an  overall  system  and/or  MOS  proponency  responsibility  to  field 
users. 

Significant  also  are  the  management  plans  and  procedures  for  resources  utiliza- 
tion and  data  collection  during  the  conduct  of  training.  These  plans  must 
be  tailored  to  the  work-training  setting,  users,  level  of  training  objectives 
(individual,  group,  team,  system),  training  resources,  and  data  collection 
requirements  of  the  training  setting.  Training  management  procedures  are  an 
essential  part  of  the  total  delivery  system  configuration  process. 
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Figure  4-1.  Relationship  of  Delivery  System  Decision  Stages 
to  Life-Cycle  Proponency  Process  and  Products 


SECTION  5.  CHARACTERISTICS  OF  CANDIDATE  DELIVERY  SYSTEMS 
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Sections  3 and  4 have  identified  the  primary  trainee  and  subject  or  job-duty 
task  selection  factors  and  the  constraint  factors  bearing  on  delivery  system 
decisions^  The  third  component  is  the  solution  factors™ characteristics  of 
methods-medla  and  specific  delivery  system  configurations  for  field  artillery 
training 

This  section  identifies  various  generic  and  specific  types  of  delivery  systems 
currently  available  or  potentially  available  for  USAFAS/unit  file  artillery 
training  in  FY  78-83,  sumarizing  certain  characteristics  useful  for  support 
of  individual-collective  training  and  evaluation. 

A.  BASIC  DELIVERY  SYSTEM  CHARACTERISTICS 

A delivery  system,  as  considered  herein,  is  any  method  containing  plans  and 
procedures  for  the  presentations,  responses,  feedback,  and  management  of 
individual,  group,  or  collective  team  training  and  evaluation.  Thus, 
delivery  system  components  include  presentation  and  response  media  (e.g., 
job  manuals-alds , job  equipment  and  tools,  devices  and  materials  for 
training  display  and  response)  as  well  as  training  management  guides 
appropriate  to  the  method,  materials,  and  setting. 

Delivery  system  methods  and  media  are  of  special  interest  in  the  training 
acquisition  process  due  to  their  implications  for  the  production,  distribution, 
delivery,  storage,  and  updating  of  training  program  materials  as  well  as  their 
impact  on  the  cost  and  effectiveness  of  the  program.  In  some  cases,  the  delivery 
system  may  include  the  capabilities  for  building  and  updating  the  training 
materials  (as  with  the  PLANIT  computer-assisted  instruction  system);  in  other 
cases,  such  as  TEC  audiovisual,  the  production  and  update  capabilities  stand 
separate  from  the  primary  delivery  system  (Beseler  Cue-See  and  audio  filmstrips). 


Delivery  system  methods  may  be  categorized  using  various  classification  schemes. 
These  include  where  the  instruction  is  to  be  presented  (classroom,  study  carrel, 
home,  or  work  environment);  how  it  is  to  be  presented  (lecture,  seminar,  demon- 
stration, or  practical  exercise);  what  the  student  is  to  do  (listen,  read, 
observe,  respond,  or  perform);  the  mode  of  presentation  (group  or  individual); 
the  nature  of  student  participation  (interactive  or  passive);  the  manner  of 
student  progression  (lock-step  or  self-paced);  and  how  the  instructional  sequence 
is  to  be  managed  (instructor,  student,  or  media  managed).  TRADOC  Reg  350-100-1 
(March  1977  draft)  suggests  and  defines  three  forms  or  methods  of  individual 
job  training:  (1)  structured  on-the-job  training  (SOJT) ; (2)  independent  self- 
study;  and  (3)  institutional  training.  FM  21-6  and  TC  21-5-7  offer  a variety 
of  methods  useful  for  individual  proficiency  and  collective  mission  training, 
keyed  to  (G)arrison  - (L)ocal  - (M)ajor  training  area  facilities. 

Delivery  system  media  are  the  means  used  to  present  instructional  and  situational 
practice  information  to  the  student,  and  for  the  student  to  make  symbolic  or 
actual  responses.  As  in  the  case  with  instructional  methods,  instructional 
media  can  be  classified  and  described  in  multiple  ways.  One  such  classifica- 
tion and  listing  of  representative  media  is  shown  in  Table  5-1.  A summary 
description  of  each  of  these  media,  containing  a synopsis  of  advantages  and 
limitations,  is  presented  in  Appendix  B. 

Often,  methods  and  media  capabilities  of  any  specific  delivery  system  are  closely 
interdependent.  For  example,  the  USAFAS  Fire  Control  Simulator  BT-33  and  the 
Observed  Fire  Trainer  (OFT),  M31  Field  Artillery  Trainer,  or  TACFIRE  computer- 
mediated  embedded  training  system  each  represent  a total  delivery  system 
configuration  of  media  and  method. 


Table  5-1. /Representative  Instructional  Media 


Instructor  with  Standard  Aids 

1. 

Instructor /Training  Supervisor 

2. 

Charts  and  Display  Boards 

3. 

Overhead  Transparencies 

Printed  Materials 

1. 

Standard  Printed  Materials 

2. 

Programmed  Instruction  Texts 

3. 

Microform 

Audio  Visual 

1. 

Audio  Tapes 

2. 

Slides  and  Sound-Slides 

3. 

Filmstrips  and  Sound-Filmstrips 

4. 

Motion  Pictures  and  Sound  Motion  Pictures 

5. 

Television  and  Video  Recordings 

Training  Devices  and  Simulators 

1. 

1 

Teaching  Machines 

2. 

Models  and  Mock-Ups 

3. 

Hardware  Simulator-Trainers 

4. 

Actual  Objects 

Computer  Mediated  Training  Support 

1.  Computer  Managed  Instruction  (CMI) 

2.  Computer  Assisted  Instruction  (CAI) 

3.  Computer-Based  Team  Training 


More  detailed  summaries  of  generic  media  characteristics  (attributes)  can  be 
generated.  These  provide  a summary  data  base  against  which  requirements  of 
subject-matter/job-task  characteristics  and  trainee  characteristics  can  be 
compared  in  the  initial  screening  of  media  candidates.  Figure  5-1,  an  apron 
foldout  on  page  5-7,  illustrates  a summary  rating  on  attributes  of  various 
media  types. 

Figure  5-1  is  a Training  Techniques  Selection  Matrix  defined  by  SDC  for  the 
first-stage  selection  of  decentralized  training  techniques  for  a tactical 
weapons  command /control  system.  The  matrix  details  the  capability  of  various 
generic  training  media  techniques  to  satisfy  any  given  set  of  display,  response 
and  strategy  parameters  of  command-control  system  training  requirements.  The 
top  partitioning  of  the  parameters  into  the  display,  response,  and  strategy 
capabilities  of  training  media  techniques  are  intended  tc  be  maximally  compat- 
ible with  behavioral  statements  of  functions,  tasks,  or  training  objectives 
which  specify  the  training  condition  (display),  trainee  behavior  (response), 
and  the  type  of  instructional  interaction  (strategy)  required.  The  display, 
response,  and  strategy  parameters  used  in  this  matrix  reflect  careful  consider- 
ation of  the  functional  skill  and  knowledge  training  requirements  for  each  of 
five  levels  of  command-control  training  requirements.^ 

The  training  media  techniques  listed  on  the  left-hand  side  of  the  selection 
matrix  fall  broadly  into  four  categories:  (1)  audiovisual  media  typically 
associated  with  classroom-group  or  individual  instructional  carrel  usage, 
omitting  those  media  which  are  multiples  or  special  cases,  such  as  multi- 
channel TV,  dial-access  audio,  and  language  labs;  (2)  hardware-oriented  tech- 
niques, such  as  actual  gear  or  dedicated  simulator-trainer  hardware;  (3)  method 


the  media  techniques,  and  the  media  parameters  at  the  top  of  Figure  5-1  are 
defined  in:  Bennik,  F. , Fallentine,  B. , Mower,  R.  Joint  Surveillance  System 
Training  Requirements  Analysis  Study:  Volume  I - Study  Analyses  (Appendices  G 
& H),  SDC  TM-5588/000/00,  31  October  1975. 
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that  merge  computer  software  support  with  other  forms  of  group  or  individual 
training  media,  such  as  computer -managed  instruction  (CMI) ; and  (4)  combined 
hardware/software  techniques  which  use  operational  consoles  for  individual 
positional  training  and  for  interaction  training  among  console  positions 
internal  and  external  to  the  command-control  center. 

Ratings  within  the  matrix  cells  of  Figure  5-1  are  intended  to  indicate  the 
relative  suitability  of  each  training  media  technique  to  meet  each  display, 
response,  and  strategy  parameter  listed  across  the  top.  The  ratings  are 
defined  as  follows: 

Blank  - Training  technique  is  not  suitable. 

1 - Training  technique  is  clearly  suitable. 

2 - Suitable  only  with  special  response  device  or  other  modification. 

3 - Suitable  only  with  instructor  control  for  individual  or  group 

training  (i.e.,  there  is  no  response  acceptance  and  evaluation 
capability  inherent  in  the  generic  media  technique). 

The  strategy  "interaction"  parameter  is  intended  to  show  the  extent  to  which  a 
training  technique  contains  integrated  response  control  of  successive  presenta- 
tions. In  addition  to  the  primary  rating  above,  the  following  encoding  is  used: 

X - Contains  integrated  response  control  of  presentation. 

Y - Presentation  can  be  controlled  by  separate  and  specialized  response 
subsystem. 

Z - Presentation  is  not  controllable  by  response  without  an  instructor 
to  obtain  and  evaluate,  responses. 

It  is  evident  that  these  ratings  are  primarily  qualitative  distinctions  with 
respect  to  the  capabilities  of  the  training  media  techniques  defined  genetically 
in  Appendix  B to  meet  display,  response  acceptance  and  evaluation,  and  group 
or  individual  intf.raction  training  requirements.  The  human  instructor  is  neither 
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Figure  5-1. 
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assumed  essential  or  unessential  to  the  use  of  each  technique.  Rather,  the 
strategy  parameter  of  usage  "mode"  shows  the  minimal  personnel  support  required 
for  use  of  the  media  technique.  Fine-grained  distinctions  In  the  capabilities 
ratings  were  not  made  among  the  media  techniques,  except  where  differentiation 
resulted  In  differences  In  capability  ratings  within  matrix  cells  or  where 
there  was  a clear  differentiation  of  technique  available  In  the  operational 
setting. 

B.  SPECIFIC  FIELD  ARTILLERY  DELIVERY  SYSTEMS 

Representative  media  attributes  (Figure  5-1  and  Appendix  B)  can  be  useful  to 
get  an  early  fix  on  the  match  of  requirements  for  an  Instructional  situation 
with  the  capabilities  of  media  to  arrive  at  the  prime  media  candidates  for 
a delivery  system.  This  Is  especially  true  when  lead  time  Is  sufficient  to 
consider  the  design  of  new  delivery  systems,  or  the  selection  and  re-conf Igura- 
tlon  of  existing  media  Into  a delivery  system.  Problems  with  this  approach 
alone  are  twofold: 

• rarely  do  specific  existing  or  prototype  delivery  system  candidates 
fit  entirely  the  generic  characteristics. 

• a variety  of  constraints  usually  have  an  overriding  Influence;  as 
was  discussed  for  five  Instructional  development  situations  In 
Section  3 and  summarized  In  Figure  3-1. 

Therefore,  a focus  on  the  specific  existing  and  potentially  available  resources 
for  field  artillery  training  and  evaluation  In  the  FY  78-83  period  Is  also 
essential.  These  resources  are  summarized  In  Table  5-2  on  the  next  two  pages. 


Table  5-2.  Field  Artillery  Training  Resources  Suiranary  (Cont. 
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i 

Table  5-2  showed  a partial  listing  of  those  delivery  systems  projected  to  be 
available  for  field  artillery  training  at  unit/USAFAS  locations  In  FY  78-83. 

i 

"Available"  here  means  either  currently  existing  in  units,  exportable  from  a 
central  source,  capable  of  remote-access  by  units  or  USAFAS  from  a central 
source,  or  procurable  for  system-site  installation.  The  availability  locations 
checked  include; 

• Unit  and  USAFAS 

• Unit  only — Bn/Bde/Div  Garrison,  Local,  or  Major  areas 

• USAFAS  or  Army  Training  Centers  only 

• Potential  access/acquisition  from  external  source  (TRADOC,  ARI,  DARCOM) 

The  general  usage  mode  is  also  indicated. 

NOTE:  An  "X"  in  Table  5-2  "Availability"  columns  means  that  there  is  a present 
capability  at  the  location  shown. 

Figures  5-2a  and  5-2b  illustrates  how  the  specific  delivery  systems  listed  in 
Table  5-2  above  could  be  compared  on  characteristics.  Figure  5-2a  shows 
comparative  display  presentation  and  response  attributes  of  TEC,  CAI,  and 
mixes  thereof.  Figure  5-2b  shows  similar  comparisons  on  training  strategy 
attributes. 

The  blank  area  in  Figure  5-2b  shows  that  the  matrix  could  be  expanded  to 
include  more  matching  parameters.  For  example: 

1.  Suitability  for  Trainee  Characteristics 

a.  Trainee  general  mental  ability  (low,  medium,  high  GT) 

b.  Trainee  specific  aptitudes  (ACB/AQB  indices) 


• verbal  (comprehension,  reasoning) 

• arithmetic  reasoning 
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Figure  5-2b.  Strategy  Attributes  of  Selected  TEC/CAI  Treatments 
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• mechanical 

• pattern  analysis  (spatial) 

• clerical  speed  (dexterity) 

• radio  code  skill 

• shop  mechanic 

• information  (automotive,  electronics,  general) 

• classification  inventory  (leadership,  self-confidence) 

Trainee  interests — from  shop  mechanic,  information,  and  classifica- 
tion subtests. 


2 . Various  Constraints;  e . g . 

a.  Relative  cost  rankings — acquisition,  operation,  maintenance, 
courseware  development,  courseware  update. 

b.  Setting,  logistical,  personnel  support  requirements — such  as  those 
shown  in  Section  3 (Figure  3-1). 

In  sum,  these  or  other  specific  Field  Artillery  delivery  system  data  descrip- 
tions will  need  further  work.  This  work  is  suggested  in  the  development  plan. 
Appendix  E. 
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SECTION  6.  EXPORTING  THE  CAI/TEC  PACKAGE  TO  FIELD  UNITS 

A.  INTRODUCTION 

This  section  describes  the  methodology  for  exporting  the  Observed  Fire  CAI/TEC 
package  developed  by  the  USAFAS  to  the  field  and  to  an  operational  FORSCOM 
unit  (e.g.,  Fort  Hood,  Texas). 

The  procedures  and  resources  required  are  based  upon  the  recent  experience  at 
USAFAS  reported  in  the  final  report.^  The  computer  used  was  the  UNIVAC  1108 
computer  at  Edgewood  Arsenal,  Maryland.  If  another  computer  is  used,  the 
procedures  for  accessing  the  computer  and  PLANIT  may  vary  somewhat  but  will 
be  generally  applicable.  The  resources  required  and  internal  PLANIT  pro- 
cedures would  be  the  same. 

It  is  assumed  that  CAI  lessons  will  be  executed  as  they  are  presently  constructed 
and  any  changes  required  would  be  effected  through  the  U.S.  .-^rmy  Research 
Institute.  Arrangements  for  use  of  the  system  are  effected  also  through  the 
U.S.  Army  Research  Institute  <^Mr.  James  Baker,  Mr.  Arthur  Marcus,  or 
Mr.  John  Larson). 

This  section'  is  organized  to  follow  the  logical  progression  of  obtaining  and 
running  the  system  in  a "normal"  progression.  The  order  in  which  the  procedures 
are  presented  in  this  section  versus  the  order  in  which  they  are  executed  in 
running  students  will  probably  vary  depending  upon  the  time  and  circumstances 
of  student  execution. 

The  resources  and  procedures  required  for  implementing  the  program  are  covered 
in  the  paragraphs  that  follow.  Specific  arrangements,  e.g.,  telephone  number 
and  account  number  to  use,  are  arranged  by  the  individuals  listed  above. 


Hoyt,  W. , Bennik,  F. , Butler,  A.  "The  Effectiveness  of  Alternative  Media  in 
Conjunction  with  TEC  for  Improving  Performance  in  MOS-Related  Tasks:  Final 
Report".  SDC  TM-5841/000/01 , 5 June  1977. 
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Figure  6-1-  Typical  Console  Arrangement 


A typical  arrangement  is  shown  in  Figure  6-1.  Printer  should  not  be  visible 
by  the  student  if  used  during  student  runs. 


B.  RESOURCES  REQUIRED 

The  resources  required  for  unit  Implementation  include  physical  resources, 
computer  resources,  courseware  resources,  procedures  guide,  appropriate 
students,  training  records,  and  training  monitor. 

1 . Physical  Resources 

a.  .M)DS  Consul  880  (If  different  console  is  used,  check  character 
set  compatibility  with  courseware  and  PLANIT.) 

b.  Telephone  (one  per  console) 

c.  Telephone  modem  (one  per  console) 

d.  Leased  telephone  line  (one  per  console) 

e.  Printer  (one  per  console) 

f.  Paper  for  printer  (20  roles  recommended  initially) 

g.  Power  source  (outlets  - three  hole  or  adapter  required) 

(1)  One  for  each  console 

(2)  One  for  each  printer 

(3)  Lighting  as  necessary 

h.  Tables,  chairs,  and  workspace  (as  required) 


I- 
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2.  Computer  Resources 

a.  PLANIT  CAI  system  on-line  on  UNIVAC  1108. 

b.  Telephone  number (s)  to  access  computer 

3.  Courseware  Resources 

The  CAI,  TEXT,  and  TEC  courseware  listed  under  separate  headings  below 
cover  the  same  objectives.  The  TEXT  lessons  are  based  upon  CAI  and 
CAI  is  based  upon  TEC.  TEXT  and  CAI  are  listed  to  show  the  course 
materials  developed  on  Observed  Fire. 

a.  CAI 

The  following  PLANIT  CAI  lessons  (permanent  files)  should  be 
on-line  on  the  UNIVAC  1108: 


PLANIT  Lesson  Name 

DODl* 

DODTA* 

DODTB* 

TL2* 

TLTA* 

TLTB* 

TL3* 

TATL3* 

TBTL3* 

CFF 

CFFTA 

CFFTB 

BCA 

BCATA 

BCATB 

BCB 

BCBTA 

BCBTB 

OFTA* 

OFTB* 


Title 

Determination  of  Direction 

Pretest 

Post  test 

Target  Location:  Polar  Plot  Method  and 
Grid  Coordinates’  Method 
Pretest 
Post  test 

Locate  a Target  by  Shift  from  a Known  Point 

Pretest 

Post  test 

The  Call  for  Fire 

Pretest 

Post  test 

Area  Fire  Mission  (Bracketing  and  Creeping 
Methods)  Part  I 
Pretest 
Post  test 

Area  Fire  Mission  (Bracketing  and  Creeping 
Methods)  Part  II 
Pretest 
Post  test 

Observed  Fire  Module  Pretest 
Observed  Fire  Module  Post-test 


*0ff-line  course  exhibits,  available  from  ARI,  are  required  for  the  asterisked 
items . 


r 


b.  Text  Presentation  (Optional) 

The  following  TEXT  MATERIAL  on  Observed  Fire,  in  paper  and  pencil 
format,  are  available  from  the  U.S.  Army  Research  Institute. 

Lesson  1.  Determination  of  Direction 

Lesson  2.  Target  Location  - Polar  Plot  Method  and  Grid 
Coordinates  Method 

Lesson  3.  Locate  Target  by  Shift  from  a Known  Point 
Lesson  4.  Call  for  Fire 

Lesson  5.  Area  Fire  Missions:  Adjustment  of  Field  Artillery 
Fire  by  the  bracketing  and  Creeping  Methods,  Part  I 

Lesson  6.  Area  Fire  Missions:  Adjustment  of  Field  Artillery 

Fire  by  the  Bracketing  and  Creeping  Methods,  Part  II 

The  above  TEXT  lessons  reflect  current  tactical  doctrine. 

c.  TEC  Lessons  (Optional) 

The  following  are  the  currently  available  TEC  lessons  on  Observed 
Fire. 

TEC  Lesson  No.  Title 

Determination  of  Direction 

Target  Location:  Polar  Plot  Method  and 
Grid  Coordinates  Method 

Locate  a Target  by  Shift  from  a Known  Point 
The  Call  for  Fire 

The  Adjustment  of  Field  Artillery  Fire 
by  the  Bracketing  and  Creeping  Methods, 

Part  I 

The  Adjustment  of  Field  Artillery  Fire  by 
the  Bracketing  and  Creeping  Methods,  Part  II 


#949-061-0001-F 

//949-061-0002-F 

m9-061-0003-F 

/^949-061-0004-F 

//949-061-0005-F 

//949-061-0006-F 
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The  TEC  lessons  will  be  updated  by  USAFAS,  as  part  of  their  normal 
update  cycle,  to  reflect  current  tactical  doctrine. 

4 . Procedures  Guide  Required 

Procedures  are  required  to  turn  on  the  equipment,  access  the  computer,  i 

execute  lessons,  obtain  student  records,  and  algn  off  the  system. 

These  are  normally  executed  in  the  following  order. 

Connect  console  to  computer. 

@ Declare  job  to  executive  system. 

(?)  Access  PLANIT. 

ADDLOG  student  names. 

Retrieve  and  execute  CAI  Lesson  as  a student. 

@ Retrieve  and  execute  CAI  lesson  as  an  author. 

Obtain  student  records. 
d)  Sign  off  PLANIT. 

d)  Sign  off  computer.  ] 

These  nine  procedural  items  are  detailed  in  Appendix  C-1.  Special 
procedures  in  Appendix  C-1  are  Items  @ (in  the  box  on  the  first  page 

of  Appendix  C-1)  and  Items  and  @ (at  the  end  of  Appendix  C-1)  ^ 

as  follows: 

d)  Correct  keying  errors  before  computer  entry. 

@ Restore  PLANIT  (to  reliable  operating  status) 

Obtain  Table  of  Contents 

j 

Keying  errors  can  occur  anytime,  either  when  getting  on  line  or  during  j 

lesson  execution. 


Item  d)  Appendix  C-1  shows  the  procedure  to  use  when  it  is  necessary 
to  restore  the  PLANIT  system.  This  will  become  evident  when  lesson 
execution  becomes  abnormal,  e.g.,  error  messages  appear  or  branching 


does  not  execute  properly.  It  is  wise  also  to  restore  PLANIT 
frequently,  e.g.,  daily  or  every  other  day  to  clean  out  the  student 
record  files  and  other  files  which  nay  have  accumulated  after  system 
use.  The  restore  procedure  normally  follows  Item  , Declare  job 
to  executive  system,  and  is  followed  by  Item  (3)  , Access  PLANIT. 

Item  © shows  the  steps  for  listing  the  table  of  contents  to  show 
what  lessons  are  available  for  access  by  students  or  authors.  Items 
or  0 

Student  Requirements 

The  series  of  lessons  are  applicable  to  all  soldiers  in  the  combat  arms 
There  is  a prerequisite,  however,  that  the  individual  has  had  Land 
Navigation  (map  reading)  and  can  read  a military  map. 

It  is  suggested  that  the  Questionnaire (S) , Appendix  C-2,  be  filled  out 
by  the  student  to  determine  that  the  prerequisite  has  been  met. 

Records  Requirements 

The  PLANIT  CAI  system  maintains  its  own  records.  These  are  as  follows; 

a.  Student  Interaction  Record,  Figure  6-2«  This  record  is 
produced  automatically  as  the  student  progresses  through  the 
course,  if  the  printer  is  on.  Everything  displayed  on  the 
screen  or  input  (responses)  via  the  console  is  recorded.  This 
record  is  optional. 

b.  PLANIT  Student  Record,  Figure  6-3a  and  6-3b«  These  are 

obtained  at  the  end  of  the  student  runs  (end  of  each  day)  by 
console  action  as  given  in  Item  . Appendix  C-1.  The  test 

record.  Figure  6- 3a,  shows  the  item  responses  for  a student  (S2) 
on  the  specified  test  (in  this  case,  lesson  name  CFFTB) . The 


I 

I 
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Figure  6-2.,  Student  Interaction  Record 
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Figure  6.3a.  PLANIT  Student  Record-Tests 
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Figure  6-3b.  PLANIT  Student  RecordT-Lesson  Execution 
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lesson  execution  record,  Figure  6-3b,  shows  the  keyed  responses 
made  by  a student  (S2)  during  lesson  execution  (in  this  case, 
lesson  CFF) . 

Figures  5_3a|  and  6-3bl shows  the  complete  HISTORY  student  record 
format,  obtained  by  keying-in  "N"  in  response  to  the  PLANIT 
prompt,  SUMMARY  ONLY  (Y/N)  ?,  shown  as  item  (7)  in  Appendix  C-1. 
The  response  "Y"  would  produce  only  the  header  data  and  summary 
information  at  the  bottom  of  the  record. 

Student  and  lesson  performance  is  automatically  recorded  and  scored 
during  lesson  execution  in  accordance  with  the  criteria  (decision 
frames)  established  for  each  lesson  and  text.  If  the  student  passes, 
he  will  automatically  go  on  to  the  next  PLANIT  lesson  programmed;  e.g., 
if  he  passes  the  DODTA  pretest  he  will  be  branched  to  the  next  pretest, 
TLTA.  Once  the  student  starts  INTRO,  then  he  should  be  able  to  progress 
through  the  lessons  automatically  as  directed  by  the  computer. 

c . Monitor's  Observation  Log 

The  monitor's  observation  log  shown  in  Appendix  C-3  is  filled 
in  by  the  monitor  to  maintain  a log  of  Individual  student  pro- 
gress, difficulties  encountered,  system  down  times,  and  other 
data  considered  appropriate  for  evaluation. 

The  monitor's  log  provides  a place  to  record  individual  lesson 
times  and  other  experience  data  which  may  be  required  or 
desired  for  evaluation.  Computer  times  are  not  available  for 
individual  lessons,  but  are  available  at  the  end  of  a run  when 
signing  off  the  UNIVAC  1108,  Step  ® in  Appendix  C-1.  The 
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example  in  Figure  6-4  shows  an  elapsed  time  of  31  minutes  for 
the  run;  i.e.,  start  17:56,  stop  18:28. 


@ FIN 

■ ‘ ’ " ' ' " 1 

1 

RUNID: 

BENNIK 

ACCT:  8556N0F1501T  PROJECT:  TECMEDIA  | 

STOP  PLANIT 

TIME: 

TOTAL: 

00:02:18.806 

CPU: 

00:00:04.254 

I/O:  00:01:51.986 

CC/ER: 

00:00:22.566 

WAIT:  00:28:18.642 

IMAGES 

READ: 

108  PAGES: 

9 

START: 

1 

17:56: 

51  FEB  24,1977 

FIN:  18:27:33:FEB  24,1977 

Figure  6-4 • End-of-Run  Accounting  Data 

d.  CAI  Attitude  Questionnaires 

The  CAI  Student  Attitude  Questionnaire  shown  in  Appendix  C-4 
is  the  one  used  by  USAFAS  for  student  runs  at  Fort  Sill  to 
measure  student  reaction  to  CAI  and  to  determine  problem  areas 
in  validating  lesson  materials. 

There  are  also  two  attitude  qre^uionnaires  on-computer  as  PLANIT 
lessons,  as  follows: 

PREQ  Pre  attitudinal  questionnaire 

POSTQ  Post  attitudinal  questionnaire 

PREQ  and  POSTQ  are  answered  on-line  and  automated  records  kept 
the  same  way  as  any  other  PLANIT  lesson.  Listings  of  the  two 
questionnaires  can  be  obtained  from  the  U.S.  Army  Research 
Institute. 
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Monitor  Requirements 


The  CAI  system,  once  the  student  is  on  line,  is  designed  to  run  by 
itself.  The  minimum  requirements  for  a monitor  is  to  turn  on  and  access 
the  system,  be  available  (on  call)  in  case  the  student  runs  into 
problems,  to  obtain  student  PLANIT  student  records  at  the  end  of  the 
session,  and  to  turn  off  the  system.  This  suggests  monitor  familiarity 
and  practice  with  the  procedural  items  contained  in  Appendix  C-1.  The 
monitor  may  also  keep  a monitor's  log  of  student  activities,  indicating 
the  times  started  and  stopped  for  each  lesson  or  series  of  lessens. 


The  student  interaction  record,  if  the  printer  is  on,  is  an  easy  method 
of  determining  student  progress  without  disturbing  the  student. 

C . PROCEDURES 

The  procedures  are  quite  simple.  When  the  student  arrives,  he  fills  out  his 
Questionnaire(3)  (Appendix  C-2).  During  this  time  (or  prior)  the  monitor  gets 
on-computer  by  carrying  out  items  through  in  Appendix  C-1.  The  first, 
lesson  obtained  for  a new  student  is  INTRO.  The  computer  will  guide  him 
through  INTRO  and  the  series  of  six  Observed  Fire  lessons,  first  administering 
the  pretest  and  then  the  lesson  and  post  test  if  the  pretest  is  failed.  If 
the  student  must  leave  at  any  time,  he  types  "<FINISHED”  (Figure  6-5),  and 
when  he  returns  and  signs  on  for  that  lesson,  he  will  be  automatically  started 
where  he  left  off.  The  off-line  course  exhibits  will  be  required  for  those 
lessons  designated  by  an  asterisk  (*)  in  paragraph  B,  3,  a.,  page  6-3. 

When  the  student  has  completed  the  lessons  (or  at  the  end  of  the  day)  student 
records  are  obtained,  as  shown  in  item  in  Appendix  C-1,  and  items  and 
@ tor  sign-off  are  carried  out. 


f 


When  you  see 


LOG  IN  OR  END 


ENTER  COMMAND 
IDENTITY  YOURSELF 


I When  you  take  a break 


Type  (exactly  as  spaced) 

(Your  name  - example  Smith)  then  press  the  NEW 
LINE  key 

GET  INTRO  - then  press  the  NEW  LINE  key 

(Your  name  - example  Smith)  then  press  the 
NEW  LINE  key 

<FINISHED  - then  press  the  NEW  LINE  key  j 


Figure  6-5 • Console  Instructions 


The  student  attitude  questionnaire  is  administered  either  off-line  or  on-line. 
If  on-line,  the  PLANIT  Lesson  PREQ  is  taken  after  INTRO.  These  can  be  obtained 
through  the  GET  command  in  item  (?) , Appendix  C-1,  or  can  be  programmed  for 
automatic  execution  by  USAFAS  or  the  U.S.  Army  Research  Institute. 


The  Observed  Fire  module  pre-  and  post  tests,  OFTA  and  OFTB,  are  also  available, 
should  it  be  desired  to  administer  these  as  a group  rather  than  individually 
as  is  currently  programmed.  OFTA  and  OFTB  are  the  combined  alternate  forms 
of  the  individual  pre-  and  post  tests  for  the  six  lessons. 

D.  EVALUATION 

The  evaluation  covers  two  areas:  (1)  do  students  learn  as  evidenced  by  their 
post  test  scores,  and  (2)  are  the  lessons  and  the  CAI  media  acceptable  to  the 
students . 


The  answer  to  the  first  question  is  determined  by  the  test  scores  of  the 
students,  i.e.,  do  they  get  through  the  course.  Feedback  on  the  post  test(s) 
provide  this  answer,  i.e.,  the  student  passed  or  failed. 


The  answer  co  the  second  question  is  determined  by  the  responses  to  the  attitude 
questionnaire,  whether  administered  on-line  (FREQ  and  POSTQ)  or  administered 
in  hard  copy  (Appendix  C-4). 

Other  considerations  include  time  required  to  take  the  lessons  and  tests,  and 
costs.  Telephone  costs  and  computer  costs  can  be  obtained  from  the  U.S.  Army 
Research  Institute. 

The  monitor's  logs  (Appendix  C-3)  should  also  be  analyzed  in  terms  of  problem 
areas,  computer  down  time  and  other  factors  which  may  be  of  interest  in  eval- 
uating CAI  in  a field  setting. 
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SECTION  7:  CONCLUSIONS  AND  RECOMMENDATIONS 

A.  CONCLUSIONS 

1.  .4  nunber  of  Army  trends  and  initiatives  will  be  influencing  field 
artillery  training  resources  utilization  during  FY  73-83.  These  include: 

(1)  the  prime  need  for  field  forces  to  acquire  and  maintain  a battle- 
readiness  posture;  (2)  designated  USAFAS  job,  mission,  and  MOS  training 
proponency  for  several  new  developmental  and  fielded  systems  in  FY  78-83; 

(3)  characteristics  and  turbulence  of  Army  job  incumbents  impacting  on 
training  loads  and  resources;  (4)  impacts  of  AR  1000-2  on  Integration  of 
USAFAS  combat  and  training  developers,  joint  TRADOC/DARCOM  responsibilities, 
and  reduction  of  system  life-cycle  costs;  (5)  impacts  of  Integrated 
Technical  Documentation  and  Training  (ITDT)  requirements;  (6)  the  volume 

of  existing  or  potentially  available  training  and  evaluation  resources 
among  units,  USAFAS,  and  TRADOC/DARCOM  sources;  (7)  changing  roles  and 
responsibilities  among  TRADOC  groups,  including  the  new  role  of  TRAQ,0C 
System  Manager;  and  (8)  goals  and  implications  for  USAFAS  internal 
resources  allocation  and  management. 

2.  USAFAS  proponency  for  supporting  the  acquisition  and  maintenance  of  pro- 
ficiency in  field  forces  will  occur  during  a period  when  weapons  system 
complexity  is  increasing  and  less  than  optimum  capabilities  are  predicted 
for  trainees  or  job  incumbents.  This  implies  a need  for:  (1)  closer 
attention  to  the  characteristics  of  soldiers  in  selecting  delivery  systems, 
and  in  the  development  and  validation  of  job-support  and  training 
packages;  (2)  Increased  realism  of  delivery  system  situational  displays, 
responses,  and  practice  for  all  training  settings;  (3)  selection  of 
techniques  less  demanding  of  scarce  or  costly  resources;  and  (4)  closer 
Integration  In  the  choice  of  delivery  systems  for  Individual  and  collective 
training  with  those  selected  for  job  and  mission  evaluation. 
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3.  USAFAS  life-ayate  proponsncy  for  system  jobs  and  MOS  structure  implies  an 
earlier  and  more  influential  role  of  the  school  TEADOC  System  Managers  to 
riinimize  operational  test  performance  gaps  and  life-cycle  costs  in  ways 
other  than  "train-up, " These  include  (1)  Integrating  system  design  with 
job  design,  human  engineering  the  man-machine  interface,  and  specifying 
personnel  selection  or  job  assignment  criteria;  and  (2)  integrating  system 
job-duty  design  with  the  EPMS/OPMS  specialty  and  skill  level  structure. 

4.  There  are  many  existing,  developmental,  and  new  delivery  systems 
potentially  useful  in  FY  73-83.  This  suggests  that:  (1)  the  notion  of 
exportability  be  broadened  to  include  individual-collective  delivery 
systems  for  training  and  evaluation  that  can  be  embedded  in  a fielded 
system,  delivered  with  a system,  or  provide  remote  access  by  units  to 
central  training  and  job  data  sources  via  telecommunications;  (2)  data 
files  should  be  established  at  USAFAS  or  central  locations  enabling 
developers  to  determine  characteristics,  operational  status,  accessibility, 
and  constraints  of  training  and  evaluation  delivery  systems. 

5.  TRADOC  goals  'with  respect  to  responsibilities,  manpower  utilization,  and 
fiscal  justifications  in  the  upcoming  period  were  siamarized.  They 
suggest:  (1)  ensuring  that  course  deslgners-developers  possess  the 
flexible  skills  needed  to  select,  develop,  and  update  media  and  courseware 
for  a variety  of  alternative  delivery  systems;  (2)  ensuring  that  school 
system  managers,  technical  directors,  and  resource  managers  can  specify 
requirements  for  procurement  packages,  monitor  work  in  progress,  and 
evaluate  contractor  plans  and  products;  and  (3)  collecting  and  summarizing 
data  on  training  effectiveness,  efficiency,  utility,  acceptance,  and 
costs  during  validations,  developmental-operational  testing,  and  user 
implementation  to  determine  benefits  and  savings. 
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6.  Delivery  system  selection  factors  include  personnel  subystem  (trainee  and 
incumbent)  characteristics,  and  individual-collective  performance  levels 
and  requirements.  Constraining  factors  include  regulatory  directives, 
available  source  data,  work-training  settings,  unit  usage  demands,  support 
capability  of  USAFAS,  leadtime,  and  costs  (acquisition,  operations,  and 
maintenance-update).  Delivery  system  solution  factors  include  media  capa- 
bility and  training  strategy  options,  training  management  methods, 
logistical  requirements,  and  availability.  These  factors  were  analysed 
against  five  developmental  requirements  predicted  for  USAFAS  in  FT  78-33: 
ITDT  Coverage  of  New  or  Developmental  System;  ITDT  Retrofit  to  Fielded 
System;  Self -Facing  of  MOS  Course  for  Export;  Self -Facing  of  WS  Course 
for  School;  and  Update  of  Fielded  ITDT/MOS  Materials.  Implications  from 
this  comparison  include:  (1)  developmental  requirements  differ  enough  so 
that  no  narrow  model  dealing  solely  with  trainee,  subject  matter,  and  media 
variables  at  one  decision  stage  will  serve  the  five  situations;  (2)  the 
model  should  integrate  the  selection  of  delivery  systems  for  ^K)S-oriented 
material,  combat  literature,  training  literature,  job-support  materials, 
training  support  materials,  and  evaluation  materials  to  maximize  compati- 
bility and  minimize  the  potential  for  massive  updates;  and  (3)  there  are 
significant  differences  among  delivery  systems  in  terms  of  the  efficiency 
and  resource  demands  in  updating  of  materials. 


^ 1.  A preliminary  delivery  system's  decision  model  was  prepared  to  satisfy 

t ; • nine  design  and  potential  evaluation  criteria.  The  model  incorporates 

decision  stages  keyed  to  the  events j available  data,  and  interim  products 

I 

? - of  a total  system  and  MOS  developmental  proponency  life-cycle.  The  four 

consecutive  decision  stages  are:  (1)  State  Delivery  System  Requirements 
and  Preliminary  Candidates:  (2)  Select  Major  Delivery  Systems  Mix  for 
' Training  Program;  (3)  Select  Delivery  Systems  for  Specific  Performance 

, Modules  and  Lessons;  and  (4)  Assign  Alternative  Delivery  Systems  During 

i 

I 

L 
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Training  Implementation.  The  types  of  decision  rules  and  available  data 
on  trainees,  performance  requirements,  delivery  systems,  and  constraints 
will  vary  for  each  stage. 

The  model  zs  designed  Co  ensi^re  a close  and  progressive  relationship 
between  SQT  standards  and  ARTEP  standards,  as  well  as  compatibility  of 
delivery  system's  selection  for  training  and  evaluation.  Each  decision 
stage  is  assigned  to  produce  decision,  data  for  input  to  an  evolving 
Individual/ Collective  Training  and  Evaluation  Plan  CJCTEP)  providing  a 
technical  devclapm.ent  and  resources  management  baseline  throughout  the 
entire  proponency  program. 

8.  Representative  media  capabilities  were  compiled  and  an  inventory  of  the 
specific  delivery  system  resources  existing  or  potentially  available  for 
field  artillery  training  in  FY  73-83  ’was  prepared.  This  indicates:  (1) 

a data  file  of  specific  field  artillery  delivery  system  attributes  should 
be  established,  those  attributes  relating  to  the  interaction  of  delivery 
system  capabilities  with  trainee,  subject-matter,  and  training  setting 
characteristics;  (2)  this  data  file  should  be  usable  within  procedural 
guidelines  to  be  developed  for  the  four  decision  stages  of  the  preliminary 
delivery  system's  selection  model. 

9.  Continued  development  of  the  TEC  Media  Selection  methodology  and  frame 
of  reference  advanced  in  this  report  is  suggested,  consisting  of  three 
steps  and  associated  tasks-:  (1)  Step  1 - USAFAS/ARI  Review,  Revisions 
and  Concurrence  on  Approach;  (2)  Step  2 - Develop  Delivery  System's 
Selection  Procedures;  and  (3)  Step  3 - Pilot  Implementation  and  Formative 
Evaluation  at  USAFAS. 


10.  Results  reported  in  the  companion  volume  ARI  TR-77-A20  and  work  on 
this  task  Indicate  that  It  Is  feasible  to  export  USAFAS-produced  CAI 
lessons  to  Army  units  via  telecommunications  access  from  the  unit  to  a 
central  computer  source.  Requirements  Include:  (1)  physical  resources, 
computer  resources,  and  courseware  resources;  (2)  procedures  guide  and 
dally  usage  procedure;  (3)  student  selection;  (A)  monitor  duties;  (5) 
use  of  automated  and  manual  records;  and  (6)  evaluation  guidelines. 
Procedures,  examples,  and  specific  forms  have  been  provided  In  this 
report. 

B.  RECOMMENDATIONS 

The  preliminary  delivery  system  decision  model  presented  In  Section  3,  4, 
and  5 has  attempted  to  provide  a framework  that  brings  together  trends 
and  Influences  Into  a coherent  frame  of  reference  for  declslon-maklng  In  the 
FY  78-83  period.  These  trends  and  Influences  Include:  findings  and  approaches 
of  Aptitude-Treatment-Interaction  (ATI) research;  Instructional  Systems 
Development  (ISD)  guidance;  evolving  Integrated  Technical  Documentation  and 
Training  (ITDT)  guidance;  Cost  and  Training  Effectiveness  Analysis  (CTEA) 
approaches;  joint  TRADOC/DARCOM  Management  of  Total  Systems  Development 
proponency  (AR  1000-2);  MOS-orlented  and  system  or  job-oriented  Army  directives 
characteristics  of  soldier  populations;  field  artillery  delivery  system 
options;  and  the  levels  and  types  of  field  artillery  performance  requirements. 

The  following  recommendations  are  provided  for  consideration  by  USAFAS: 

1.  Assess  whether  assumptions  (Section  1,  part  C)  and  conclusions  are  reason- 
able, and  how  these  should  influence  subsequent  work  on  delivery  systems 
methodology. 

2.  Assess  accuracy  of  the  Initiatives,  directives,  trends,  and  implications 
cited  In  Section  2,  as  well  as  the  decision  factors  and  USAFAS  situational 
development  Implications  presented  In  Section  3. 
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Determine  whether  the  subsequent  work  focus  should  be  on  one  or  a com- 
bination of  the  four  decision  stages  in  the  overall  model;  i.e.,  (1) 

State  Delivery  Systems  Requirements  and  Preliminary  Candidates;  (2) 

Select  Major  Delivery  Systems  Mix  for  Training  Program;  (3)  Select 
Delivery  Systems  for  Specific  Performance  Modules  and  Lessons;  and  (4) 
Assign  Alternative  Delivery  Systems  during  Training  Implementation.  Each 
of  the  stages  has  different  implications  on  data  requirements  and  sources, 
decision  goals,  decision  procedures,  and  decision  outcomes. 

Assess  which  trainee  data  is  available,  and  how  it  is  gathered  and  used 
in  any  or  all  of  the  four  decision  stages.  Useful  trainee  data  will  vary 
depending  on  the  decision  purpose.  Potential  sources  Include:  data  banks 
(DCSPER,  MILPERCEN,  SIDPERS);  ACB/AQB  aptitude  subtest  scores;  general 
mental  abilities  (GT);  experiential  questionnaires  administered  to 
soldiers;  specialized  individual  difference  measures;  cognitive-perceptual 
style  instruments  or  derived  indices  from  other  sources;  attitudlnal 
Inventories;  and  observed  trainee  preference  among  alternatives  provided 
in  the  training  setting.  Observed  preferences  can  be  correlated  with 
other  data  items  to  determine  what,  if  any,  stable  relationships  exist. 

The  above  recommendations  should  be  given  early  consideration  during 
Step  1 of  the  developmental  workplan  provided  in  Appendix  E to  better 
focus  Step  2 of  the  workplan. 

The  above  recommendations  should  be  given  consideration  in  planning  field 
data  collection  on  CAI/TEC/Test  exportable  packages,  using  implementation 
procedures  given  in  Section  6 and  Appendix  C.  Appropriate  data  collection 
can  provide  data  useful  to  the  delivery  systems  model  and  data  files 
suggested  in  this  report. 
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It  is  apparent  that  the  FY  78-83  projections  and  preliminary  solutions 
given  in  this  report  have  implications  for  several  directorates  within 
USAFAS  (e.g.,  Training  Developments  and  Directorate  of  Evaluation).  It 
is  also  recommended  that  reactions  and  inputs  of  other  service  schools 
and  groups  (e.g.,  TDI,  ATSC,  TRADOC  DCST,  ARTADS)  be  solicited. 
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APPENDIX  A 

EXAMPLES  OF  DELIVERY  SYSTEMS  SELECTION  RATIONALE 
FOR  AN  INDIVIDUAL-COLLECTIVE  TRAINING  PLAN 

A-1:  SELECTION  RATIONALE  FOR  TRAINING  PROGRAM 
A-2:  SELECTION  RATIONALE  FOR  SPECIFIC  LESSONS 
A-3:  COST-AVOIDANCE  ESTIMATES  SUPPORTING  DELIVERY  SYSTEMS 

These  examples  illustrate  the  types  of  supporting  rationale  for  delivery  systems 
selection  considered  appropriate  outcomes  of  the  front-end  analysis  and  pre- 
liminary design  phases  of  a major  service  school  system,  job-duty,  and  MOS 
life-cycle  proponency  program.  The  examples  are  actual  products  generated  in 
support  of  the  USAFAS  TACFIRE  Advanced  Training  Program  and  Individual-Collective 
Training  Plan  in  which  SDC  participated  as  subcontractor  under  prime  guidance 
of  Litton  Data  Systems  and  USAFAS.  This  program  included  a requirement  for 
Integrated  Technical  Documentation  and  Training  (ITDT)  coverage.  Appendices 
A-1  and  A-2  are  from  information  in  Litton  Document  MS  77298-2,  dated 
24  February  1977.  Appendix  A-3  is  a Cost  and  Training  Effectiveness  Analysis 
(CTEA)  supporting  the  delivery  systems  selection,  generated  by  a USAFAS/Litton 
team  and  reported  in:  Individual-Collective  Training  Plan  for  TACFIRE,  HO 
TRADOC,  October  1976. 

These  examples  supplement  information  in  Section  4 of  this  report. 
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A-1:  SELECTION  RATIONALE  FOR  TRAINING  PROGRAM 

Media  Selection  for  TACFIRE  Training 
(Litton  Document  148000-901) 

1.  PURPOSE 

The  purpose  of  this  document  is  to  provide  the  general  requirements  and 
rationale  for  the  selection  of  media  for  each  lesson  segment  (Lesson  Design 
Approach  document)  within  the  TACFIRE  Advanced  Training  Program. 

2.  PRIMARY  CONSIDERATIONS 

A key  element  of  Phase  1 of  the  TACFIRE  Advanced  Training  Program  was  the 
selection  of  the  appropriate  delivery  systems/media  for  presentation  of  Che 
individualized,  self-paced  training  materials.  Three  primary  considerations 
have  been  levied  on  the  selection  of  media: 

a.  All  media  must  be  available,  or  readily  exportable,  to  the  field 
units  with  a minimum  or  no  introduction  of  speci.il  devices  or  equip- 
ment unique  to  TACFIRE  training. 

b.  The  training  program  and  the  media  used  must  reduce  the  overall  life 
cycle  cost  of  the  resident/school  training  program. 

c.  The  media  selections  must  be  consistent  with  the  overall  TACFIRE 
training  requirements. 

Analysis  of  knowledge  and  skills  to  be  taught  as  part  of  the  TACFIRE 
Advanced  Training  Program  has  resulted  in  the  selection  of  specific  media  to 
accomplish  the  program  objectives.  The  following  discussion  provides  the 
rationale  for  media  selection  in  the  TACFIRE  Advanced  Training  Program. 

3.  EVALUATION  FACTORS 

In  the  selection  of  any  medium  for  individualized  Instruction,  there  is  a 
strong  interaction  between  constraints  and  solutions.  No  single  approach  is 
selected  based  on  only  one  or  two  factors.  Every  selection  results  from  an 
evaluation  of  numerous  factors  such  as: 

a.  Characteristics  of  the  student  population 

b.  Characteristics  of  Che  subject  matter 

c.  Features  of  the  work  environment 

d.  Characteristics  of  the  training  environment 
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e.  Ability  to  apply  training  materials  in  the  field, as  well  as  the  school 

f.  Cost  constraints 

g.  Time  constraints 

4.  MEDIA  CATEGORIES 

While  there  are  numerous  different  kinds  of  instructional  media,  certain 
aedia  are  popular  because  of  their  flexibility  in  meeting  the  considerations 
posed  by  the  above  factors.  These  media  fall  into  the  following  basic 
categories : 

a.  Printed  text 

b.  Audio-visual 

c.  Simulation 

d.  Audio  only 

e.  Person-to-person  (platform  and  tutorial) 

5.  MEDIA/DEVICE  TYPES 

The  instructional  media  and  devices  considered  for  use  in  the  TACFIRE 
Advanced  Training  Program  were  as  follows: 

a.  Printed  Text 

(1)  Programmed  text 

(2)  Job  Performance  Manuals/Job  Performance  Guides  (JPM/JPG) 

(3)  Technical  Manuals/Field  Manuals  (TMs/FMs) 

(4)  Job  aids 

b.  Audio-visual 

(1)  Video  tape 

(2)  Video  disc 

(3)  Sound  slide 

(4)  Motion  picture 

(5)  35mm  film  strip  and  sound 

(6)  Beseler  Cue/See 
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c.  Simulation 

(1)  Computer  Assisted  Instruction  (CAI) /Computer  Mediated  Practice 

(2)  System  Simulation 

d.  Audio  only 

(1)  Portable  audio  cassette  players 

e.  Person-to-Person 

(1)  Platform  instruction 

(2)  One-to-one  tutorial 

6.  MEDIA  SELECTIONS 

The  extreme  Importance  and  emphasis  on  availability  of  the  selected  media 
in  the  field  has  greatly  influenced  the  selection  process.  This  is  particu- 
larly true  in  the  audio-visual  category.  The  Bescler  Cue/See  was  selected  to 
satisfy  the  audio-visual  requirements  primarily  due  to  its  availability  in  the 
field.  The  U.  S.  Army's  Training  Extension  Course  (TEC)  program  has  pro- 
grammed approximately  eight  Beseler  Cue/See  machines  for  every  field  army 
battalion.  This  selection  makes  machines  available  to  the  TACFIRE  units  and 
also  ensures  compatibility  of  TACFIRE  with  the  Army's  TEC  program.  Many  of 
the  audio-visual  lessons  could  be  converted  to  other  media  such  as  video  disc, 
video  tape,  or  other  audl’b-visual  media  as  they  become  available  in  the  field. 

Similarly,  the  In-unlt  field  training  considerations,  .ns  well  as  resident 
school  cjst  and  scheduling  considerations,  lead  away  from  the  selection  of 
platform  instruction  for  TACFIRE  specific  training.  There  appears  to  be  no 
need  in  TACFIRE  for  audio-only  training  materials. 

The  major  media  selected  for  TACFIRE  training  are  the  following: 

a.  Programmed  Text 

b.  JPMs/JPGs  (TMs  already  exist  for  use  in  place  of  JPCs) 

c.  Job  Aids 

d.  Audio-visual  (Beseler  Cue/See) 

e.  CAI/Computer  Mediated  Practice 

f.  System  Simulation 
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I 7.  effectiveness /RATIONAL!: 

, The  effectiveness/rationale  of  the  individual  media  selections  is 

^ discussed  in  the  following  paragraphs: 

I a . Programmed  Text 

The  programmed  text  traditionally  has  been  the  workhorse  of  individual- 
ized instruction.  It  is  low  cost,  highly  portable,  and  can  be  used  to  teach 
a wide  variety  of  skills  and  knowledges.  In  the  TACFIRE  program,  a large  part 
of  the  training  involves  the  use  of  formats  to  enter  data  into  the  system  and 
to  receive  output  data  from  the  system.  Data  is  entered,  altered,  and  deleted 
using  these  formats.  The  TACFIRE  format  is  a moderately  complex  geometric 
configuration  (similar  to  a punched  card  format)  which  contains  mnemonic  codes 
indicating  the  proper  location  for  data  entries. 

The  programmed  text  is  an  ideal  method  for  providing  practice  in  data 
entry  short  of  actually  putting  tlie  student  at  tlie  system  equipment.  With  tlte 
format  printed  on  the  page,  the  student  can  record  his  answers  right  on  the 
printed  format  and  then  compare  this  answer  to  the  printed  confirmation  on  the 
next  page.  One  of  the  few  drawbacks  associated  with  the  use  of  itie  programmed 
text  is  that  the  student  must  be  able  to  read  the  text.  In  cases  where  the 
content  contains  new  terms  and  concepts,  tlie  program  may  exceed  some  students' 
reading  levels.  Lessons  containing  new  verbal  content  will  be  taught  using 
an  audio-visual  approach  rather  than  tlie  programmed  text  to  take  advantage  of 
che  students’  greater  listening  vocabulary. 

b.  JPM/JPG  (TM) 

Job  Performance  Manuals  and  Job  Performance  Guides  are  an  effective 
medium  to  employ  when  teaching  the  soldier  specific  operations  and  procedures 
which  are  performed  on  equipment.  The  use  of  the  JPM/JPG  requires  access  to 
the  equipment  while  performing  the  steps.  An  Important  instructional  advantage 
of  this  approach  is  that  the  soldier  is  in  contact  with  the  real  world  environ- 
ment rather  than  an  artificial  representation  of  the  real  world,  and  he  is  able 
to  practice  the  actual  operations  to  be  performed.  This  practice  may  be  on  the 
system  during  actual  field  operation  or  on  the  system  equipment  with  simulation 
software  to  simulate  actual  field  operation. 
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From  a cost  standpoint,  original  production  and  reproduction  of  the  JPM/JPC 
Is  comparable  to  a programmed  text.  In  this  program,  the  JPM/JPG  is  used  in 
two  different  ways.  In  some  lessons,  it  is  used  as  the  primary  training  vehicle 
and  guides  the  soldier  through  a sequence  of  steps. 

The  second  application  of  the  JPM  is  as  an  elaborate  Job  Aid.  When  the 
soldier  is  taught  the  use  of  formats  in  TACFIRE,  the  programmed  text  is  used 
to  present  a graduated  series  of  exercises  on  filling  in  formats.  To  complete 
the  exercise  requires  thie  use  of  a' JPM  which  contains  a definition  of  the  dif- 
ferent mnemonics  contained  In  the  format  and  conditions  for  making  entries  into 
the  format  fields.  This  enables  the  soldier  to  acquire  technical  competence 
with  a wide  range  of  formats  without  the  necessity  of  memorizing  the  large 
number  of  terms  and  conTditions. 

In  the  case  of  the  TACFIRE  system,  detailed  TMs  already  exist.  The  TACFIRE 
system  operation  and  the  organizational  maintenance  concepts  make  extensive 
use  of  computer  programming  and  special  hardware  design  to  assist  in  fault 
detection,  fault  isolation  and  overall  system  operation.  For  this  reason,  the 
existing  TMs  contain  ail  the  information  which  would  normally  be  contained  in 
the  JPGs  for  a system  of  this  type.  Therefore,  the  TMs  will  be  used  to  satisfy 
the  TACFIRE  system  operational  and  "organizational  maintenance  JPG  requirements. 

c . Job  Aids 

The  use  of  job  aids  is  an  effective  and  economical  addition  to  the 
training  materials.  A job  aid  can  effectively  reduce  the  training  time, 
enhance  job  proficiency  and  reduce  latency  times  by  serving  as  a memory  cue 
(l.e.,  checklist)  or  by  eliminating  the  need  for  memorization  (i.e.,  data 
lists,  typical  data  identification  or  allowable  limits,  format  location  keys). 
The  TACFIRE  requiremehts  lend  themselves  to  the  use  of  decals,  plasticized 
cards,  small  pocket  booklets  as'quick  reference  aids  to  the  performance  of  the 
job. 

d.  Audio-visual  (Beseler  Cue/See) 

One  of  the  strongest  reasons  for  going  to  an  audio-visual  approach  is 
that  the  lesson's  instructional  effectiveness  does  not  depend  on  the  student's 
reading  level.  Therefore,  marginal  readers  learn  better  from  audio-visual 

devices. 


Another  advantage  of  tho  audio-visual  approach  is  in  its  effectiveness  in 
showing  operations  perfornied  on  equipment.  It  provides  for  the  use  of  high 
qu.'llty  color  pictures  of  equipment  and  allows  the  learner  to  maintain  contin- 
uous visual  contact  with  a changing  visual  display  while  listening  to  an  audio 
commentary.  This  can  be  compared  to  an  Illustrated  text  where  the  learner 
"ust  glance  back  and  forth  between  text  and  illustration. 

Most  programs  that  teach  equipment  operations  require  a large  number  of 
color  visuals  to  show  each  step  of  a procedure  and  the  subsequent  changes  in 
the  equipment's  controls  and  Indicators.  The  cost  of  reproducing  large  num- 
bers of  color  visuals  in  film  is  lower  than  in  printed  text  with  color  printing. 

Another  advantage  of  the  nudio-visual  approach  is  its  appeal.  Most  people 
prerer  the  audio-visual  approach  over  non-AV  approaches  and,  thetefore,  it  is 
more  motivating  to  the  student. 

Another  essential  factor  to  consider  when  selecting  an  audio-visual 
approach  is  the  costs  associated  with  the  approach.  Cost  can  be  divided  into 
the  following  three  major  categories: 

(1)  Implementation  Costs  — These  are  the  costs  associated  with  the 
acquisition  and  maintenance  of  the  audio/visual  devices  at  the. training  site. 

In  this  case,  the  Army  has  already  selected,  purchased,  and  deployed  the 
Beseler  Cue/See  at  numerous  sices  as  part  of  the  Army's  Training  Extension 
Course  (TEC)  program.  Implemeatat ton  costs  associated  with  using  the  Beseler 
Cue/See  as  a training  device  are  thereby  minimized  from  that  of  introducing 

a new  device  into  the  field. 

(2)  Reproduction  Costs  — These  arc  costs  for  reproduction  of  copies 
of  the  8mm  film  and  cassette  capes.  Presently,  there  are  several  contractors 
set  up  to  produce  copies  of  Cue/See  programs  at  reasonable  prices.  As  part  of 
the  TEC  program,  the  cost  of  program  reproduction  is  extremely  low. 

(3)  Development  Costs  — These  are  costs  to  prepare  and  film  artwork, 
prepare  and  record  scripts,  and  test  and  revise  programs.  As  a rough  rule  of 
thumb,  developmental  cost  for  a Cue/See  lesson  will  run  about  three  times  as 
■uch  as  a programmed  text,  but  only  ocic-fiftli  to  one-tenth  the  cost  of  producing 
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ooclon  picture.  Considerable  economies  are  realized  by  selecting  the 
Cue/See  as  the  audio-visual  training  device  for  the  TACFIRE  program.  | 

a.  CAI/Computer  H^dlatec}  Practice  | 

^ ^ ~ I 

CAl  utilizes  a computer  to  generate  displays,  atialyzc  student  responses,  j 

and  instantly  reconfigure'  the  instructional  sequence  for  each  individual  ' 

student  based  on  his  performance.  | 

CAI  can  be  relatively  expensive,  more  so  in  equipment  utilization  require- 
ments than  in  courseware  development  costs.  CAI  would  not  be  used  to  teach  | 

behaviors  that  could  be  taught  just  as  well  with  less  costly  instructional  ^ 

approaches.  Costs  for  CAI  are  generally  divided  into  three  main  areas.  These  ' 

are: 

(1)  So f t wt^r,e . Refers  to  the  computer  program  that  controls  the  com- 
puter actions  during  instruction. 

(2)  Hardware . Refers  to  equipment  including  the  computer  itself,  and 
the  peripheral  input  and  output  devices. 

(3)  Courseware.  Refers  to  the  instructional  program  that  is  put  into 
the  computer. 

The  PLANIT  (Programming  Language  for  Interactive  Teaching)  CAI  software 
for  TACFIRE  has  been  basically  developed  under  a separate  research  contract 
with  the  Army  Research  Institute.  This  software  operates  completely  on 
TACFIRE  tactical  equipment.  For*^  this  reason  there  is  minimal  software  and 
equipment  development  and  procurement  costs  associated  with  using  CAI  for 
TACFIRE.  For  these  reasons  the  use  of  CAI,  where  appropriate,  for  TACFIRE 
training  is  a practical’  and  necessary  media. 

The  words  "Computer  Mediated  Practice"  more  aptly  describe  the  instruc-  i 

tlonal  application  of  the  computer  in  TACFIRE  training  than  does  the  term 
computer  assisted  instruction.  (Computer  mediated  practice  in  TACFIRE  will 
allow  the  trainee  to  apply  skills  and  knowledges  learned  via  other  media  to 
the  operation  of  the  Artillery  Control  Console  (ACC)  and  the  Variable  Format 
Message  Entry  Device  (VFMED) . Just  as  a learner  cannot  become  a good  auto- 
mobile driver  without  driving  practice,  likewise  the  console  operators  cannot 

i. 
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become  proficient  without  practice  on  the  console.  Computer  mediated  practice 
provides  for  the  presentation  of  a wide  variety  of  staged  exercises  and  real 
world  simulations  that  are  not  possible  in  the  conventionally  configured 
TACFIRE  system. 

f . System  Simulation 

In  addition  to  individualized  hands  on  practice  on  the  ACC  and  VFMED, 
practice  with  ocher  system  equipment  and  subsystem  team  practice  are  required 
for  TACFIRE  training.  A relatively  inexpensive  system  simulation  software 
package  will  be  developed  to  operate  with  the  TACFIRE  field  software  on  the 
actual  tactical  field  equipment  to  provide  individual  and/or  team  practice 
exercises  in  a (simulated)  real  world  environment.  These  exercises  can  be 
performed  in  the  school  environment  or  in  the  field. 

8.  CONCLUSION 

The  media  identified  for  use  in  TACFIRE  training  provide  a well  rounded 
course  of  instruction  which  will  meet  the  TACFIRE  training  requirements  and 
satisfy  the  primary  considerations  identified  at  the  beginning  of  this 
discussion . 
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A-2:  SELECTION  RATIONALE  FOR  SPECIFIC  LESSONS 

Example  Lesson  Design  Approaches 
(Litton  Documents  148201-601  and  148201-603) 


LESSON  DESIGN  APPROACH 


LESSON  TITLE: 


ACC  OPERATION  - PART  1 


LESSON  NUMBER: 


2.01-1  AV 


TARGET  AUDIENCE:  See  Training  Managers  Guide,  Document  No.  148000-900,  Appendix  C 


STUDENT  MATERIALS:  Paper  and  pencil 


OBJECTIVES: 


1.  The  soldier  will  identify  the  components  of  the  ACC. 


INSTRUCTIONAL 
STRATEGY : 


2.  The  soldier  will  specify  the  function  of  each  ACC  control, 
indicator,  key  or  switch. 

This  A/V  lesson  will  teach  the  soldier  the  functions  of  the  ACC 
in  the  TACFIRE.  system.  The  lesson  will  illustrate  each 
component  of  the  hCC,  testing  the  soldier's  ability  to  name 
each  component  Illustrated  in  the  test  exercises.  The  lesson 
will  also  teach  the  function  of  each  component. 


CONTENT  OUTLINE: 


This  lesson  will  provide  illustrations  and  descriptions  of  the 
physical  characteristics  and  applications  of  the  ACC. 


CRITERION  TEST: 


The  soldier  will  be  asked  to  perform  all  the  tasks  listed  in  the 
objectives  presented  earlier  in  this  LDA. 


He  will  perform  the  tasks  using  the  JPM  as  a reference, 
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METHOD /MED I A 
SELECTION: 


EFFECTIVENESS 

A.NALYS1S: 


LESSON 

.JJ)MINISTRATIVE 

INSTRUCTIONS: 


VALIDATION: 


Audio-visual 


General  - See  MEDIA  SELECTION  FOR  TACFIRE  TRAINING,  Document 
No.  148000-901. 

Specific  — The  audio-visual  format  was  selected  for  teaching  this 
lesson  because  the  teaching  sequence  requires  continuous  monitor- 
ing of  a changing  visual  display  accompanied  by  an  audio  commen- 
tary, and  because  it  is  a convenient  medium  for  depicting  the 
Interrelationship  of  various  elements  taught  in  this  lesson. 

The  Lesson  Administrative  Instructions  (LAIs)  will  include 
the  title  of  the  lesson,  the  required  materials,  the  objectives 
and  the  approximate  time  required  to  complete  the  lesson.  The 
LAI  will  also  contain  instructions  for  administering  the 
lesson. 

This  lesson  should  be  validated  in  small  group  trials  with  no 
less  than  ten  soldiers.  The  criterion  for  acceptable  validation 
is  90/90. 
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LESSON  DESIGN  APPROACH 

LESSON  TITLE:  ACC  OPERATION  - PART  3 

LESSON  NUMBER:  2.01-3  CAI 

TARGET  AUDIENCE:  See  Training  Managers  Guide,  Document  No.  148000-900,  Appendix  G 


STUDENT  MATERIALS:  Paper,-  pencil  and  JPM 

OBJECTIVES:  1.  'Given  instructions  to  call  up  a particular  format,  the  soldier 

will  use  the  SPA  matrix- to  request  that  format. 

2.  Given  instructions  to  call  up  a particular  format  (not  stated 
on  the  SPA  matrix),  within  a category  directory  listing,  the 
soldier  will  request  the  specified  format. 


3.  Given  Instructions  to  adjust  the  brightness,  character  size, 
or  focus  of  the  CED,  the  soldier  will  identify  and  turn  the 
actual  knobs. 


INSTRUCTIONAL 
STRATEGY : 


f 


This  is  the  first  of  three  lessons  which  practice  the  soldier  j 

on  the  operation  of  the  ACC.  In  this  lesson  the  soldier  will  * 

I 

receive  his  training  instructions  on  the  RD/ELP.  The  lesson  will  j 

consist  of  drills  to  familiarize  the  operator  with  the  function  I 

of  the  matrix,  command,  and  select  buttons  of  the  SPA  and  cursor 
positioning  of  the  A/N  keyboard.  Following  the  drills,  the 
soldier  will  be  given  timed  exercises  in  which  he  must  use  a key, 
switch,  or  series  of  controls  to  perform  a task  as  specified  In 
the  instructions  on  the  RD.  The  soldier  will  be  evaluated 
against  specified  time  parameters  for  completion  of  an  exercise. 

The  soldier  will  repeat  a series  of  drills  until  mastery  as 
specified  in  the  LAI  is  achieved. 
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CONTENT  OUTLINE:  Drills  will  consist  of  the  soldier  calling  up  at  least  one  formal 

from  each  format  category  using  the  MATRIX.  Format  call-ups 
using  the  format  directory  will  be  from  each  category. 

CRITERION  TEST;  The  soldier  will  be  askod  to  perform  all  the  tasks  listed  in  the 

objectives  presented  earlier  in  this  LDA.  He  will  use  the  JPM 
as  a guide  while  performing  the  cask. 

METHOD /ME Jl.-\  Computer  Assisted  Instruction 

SELECTION: 

General  - See  MEDIA  SELECTION  FOR  TACFIRE  TRAINING,  Document 
No.  148000-901. 

Specific  — CAI  was  selected  for  use  in  this  lesson  because  it 
allows  the  soldier  to  practice  newly  acquired  skills  on  the  real 
world  equipment.  The  levels  of  proficiency  which  are  the  objec- 
tive of  this  lesson  necessitate  practice  on  hardware  and  this 
programmed  practice  can  only  be  accomplished  through  the  use  of 
CAI. 

The  Lesson  .Administrative  Instructions  (L.A]s)  will  include 
the  title  of  the  lesson,  the  required  materials,  the  objectives 
and  the  approximate  time  required  to  complete  the  lessor.  The 
LAI  will  also  contain  instructions  for  administering  the 
lesson. 

V.ALIDATION:  Final  validation  will  take  place  with  no  less  than  ter.  soldiers. 

Upon  completion  of  the  lesson,  each  soldier  should  be 
performance  tested  on  the  actual  equipment.  The  criterion  for 
acceptable  validation  is  90/90. 


LESSON 

ADMINISTRATIVE 
INSTRUCTIONS : 


EFFECTIVENESS 

A.\’ALYSIS/ 

RATIONALE: 
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A-3:  COST-AVOIDANCE  ESTIMATES  SUPPORTING  DELIVERY  SYSTEMS 

Estimated  Savings  from  Individualized,  Self-Paced  Instruction 
(Appendix  E,  Individual-Collective  Training  Plan  for  TACFIRE,  Oct  76) 


E . 1 . TACFIRE  Advanced  Training  Program. 

Phase  1 of  the  TACFIRE  Advanced  Training  Program  (Reference  s)  has  addressed 
the  overall  program  definition  of  Individualized,  self-paced  "Improved 
Technical  Docunentatlon  and  Training  (ITDT)"  program  for  TACFIRE.  Phase  2 
will  address  the  detail  design  definition  for  the  program  prior  to  full 
scale  Implementation  and  training  materials  (Phase  3) . 

The  subject  program  addresses  operational  training  and  organizational  main- 
tenance training  for  FSO,  FSEi  Div  Arty  FDC  and  Bn  FDC.  The  forward  ob- 
server and  firing  battery  training  were  not  included  as  these  are  being 
separately  developed  as  self-paced  training  courses  as  a part  of  the  current 
TACFIRE/BCS  programs.  DS  maintenance  was  also  not  Included  in  the  subject 
program. 

The  Phase  1 results  show  rather  dramatic  reduction  in  the  average  instruc- 
tional time  for  TACFIRE  students.  A major  portion  of  these  savings  are  the 
direct  result  of  individualizing  the  instructional  requirements  for  each 
duty  position.  For  example,  the  training  requirements  for  a Fire  Direction 
Sergeant,  TACFIRE  Equipment  Specialist,  and  Counterfire  Officer  are  signifi- 
cantly different.  The  current  platform  instruction  includes  one  common  Fire 
Direction  Course  (10  weeks)  for  all  duty  positions  at  Div  Arty  and  Bn  Fire 
Direction  Centers  and  a common  Fire  Support  Course  (4  weeks)  for  all  FSE  and 
FSO  duty  positions. 

At  Annex  1 to  this  appendix  is  the  preliminary  training  matrix  from  Phase  1. 
The  left  side  lists  the  TACFIRE  performance  modules  (a  lesson  or  series  of 
lessons).  Across  the , top  are  the  duty  positions  requiring  TACFIRE  instruc- 
tion. In  section  I are  duty  positions  trained  within  the  Fire  Direction 
Course.  In  section  II  are  duty  positions  trained  within  the  Fire  Support 
Course.  Section  III  are  seven  of  the  fourteen  duty  positions  trained  in 
the  Comm.and  and  Staff  Course  which  can  be  self-paced  as  a direct  result  of 
self-pacing  the  Fire  Direction  Course  and  the  Fire  Support  Course,  Section 
IV  shows  those  posltlohs  whlnrh'  receive  no  formalized  school  training  but 
receive  limited  training,  from  the  New  Equipment  Training  Team  In  the  field. 
Personnel  In  these  positions  can  function  without  the  training  but  can 
function  more  effectively  with  the  training. 


aiL..,.. 


•Although  cost  savings  are  enumerated  in  this  appendix  only  for  the  Fire 
Direction  Course  and  the  Fire  Support  Course,  the  benefits  derived  from 
seif-pacing  the  TACFIRE  instruction  overflow  into  the  Command  and  Staff 
Course  and  into  the  very  important  realm  of  exportability  and  OJT  enhance- 
ment in  the  field.  The  former  then  requires  only  half  as  many  students  for 
the  formal  classroom  instruction.  The  latter  provides  a structured  OJT 
program  for  those  personnel  who  require  some  TACFIRE  training  to  increase 
their  effectiveness  but  do  not  require  a significant  amount  to  necessitate 
formal  school  training. 

At  Annex  2 to  this  appendix  is  the  overall  self-pacing  cost  analysis  for 
TACFIRE  instruction  in  both  the  Fire  Direction  Course  and  the  Fire  Support 
Course.  At  Annex  3 is  the  cost  development  model.  Although  these  were 
submitted  to  the  Training  Management  Institute  (TMi)  separately  for  each 
course,  both  analyses  and  models  were  combined  here;  because,  as  can  be 
seen  in  Annex  1,  many  modules  (lessons)  are  common  to  both  courses.  For, 
this  reason,  funding  for  self-pacing  the  two  TACFIRE  courses  through  contrac- 
tor assistance  must  not  be  considered  separately.  Discrepancies  between  these 
annexes  and  that  submitted  to  TMI  are  due  to  the  latest  available  information 
being  included  herein. 

The  Phase  1 course  length  estimates  are  preliminary  and  may  experience  some 
growth  as  more  detailed  data  is  developed  in  Phases  2 and  3.  The  detailed 
savings  resulting  from  introduction  of  the  individualized  self-paced  modules 
cannot  be  precisely  estimated  at  this  time.  However,  for  purposes  of  this 
plan  a "best  case",  "worst  case"  and  "average"  potential  savings  in  instruc- 
tors, student  salary  (during  training)  and  student  TDY  costs  have  been  de- 
veloped . 

The  savings  is  based  on  the  Phase  1 estimated  lesson  lengths  with  the  fol- 
lowing assumptions: 

a.  A possible  30  percent  growth  in  lesson  lengths  from  the  Phase  1 
estimates . 


b.  The  average  student  can  complete  30  hours  of  self-paced  lesson 
materials  per  week. 

c.  Integration  of  the  self-paced  course  of  instruction  into  resident 
instruction  begins  with  the  FY  80  courses. 

d.  It  is  estimated  that  up  to  50  percent  of  the  self-paced  TACFIRE 
training  can  be  transitioned  from  the  school  (USAFAS)  to  the  field  units 
following  full  TACFIRE  deployment.  Following  the  establishment  of  a train- 
ing base  in  the  field  (i.e.,  an  adequate  number  of  trained  personnel  to 
supervise  the  unit  training),  this  percentage  may  be  Increased.  However,  a 
detailed  study  of  this  proposition  can  be  made  only  after  the  results  of 
the  module  validations  have  been  correlated. 

E.2.  Fire  Direction  Course  Savings. 

a.  Estimated  Instructor  Savings.  It  is  estimated  chat  self-pacing. 


r 
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r.odulartty  of  the  TACFIRE  Instruction  and  exportability  will  reduce  the 
TACFIRE  Instructor  requirements  for  the  Fire  Direction  Course  33-67  per- 
cent. For  this  reason,  an  '^average"  potential  savings  of  50-percent  has 
been  ur.ed  in  the  following  computations: 


FY7* 

FY79 

FY80 

FY81 

FY82 

FY83 

FY84 

FY85 

Reqiiirr.d  Platform 
Instructors  from  Annex  1 

21.6 

21.6 

28.8 

36.4 

45.6 

45.6 

45.6 

45.6 

CO  Ap'P'  ndlx  D(a). 

" 50%  "average"  potential 
savings 

14-.  4 

18.2 

22.8 

22.8 

22.8 

22.8 

TOTAL  INSTRUCTORS 

21.6 

21.6 

14.4  ■ 

ia.2. 

22.8 

22.8 

22.8 

22.8 

(16)* 


*NOTE:  Lab  excrqises  (practical  exercise)  require  the  use  of  a minimum  of 
one  Instructor  per,,  computer  to  .preclude  inadvertent  student  daimage  to  the 
equipment,  tapes,  etc.  Also,  one  instructor  Is  required  for  each  ITS. 

The  net  estimated  average  Instructor,  savings  for  the  Fire  Direction  Course 
based  on  self-pacing  and  exportability  to  the  field  are: 

FY78  FY79  FY80  FY81  FY82  FY83  FY84  FY85 

Estimated  Instructor  -• 12.-8  18.2  22.8  22.8  22.8  22.'8 

Savings 

b.  Estimated  Student  Savings-;  In  addition  to  the  Instructor  savings, 
the  reduced  Instructional  time  and  the  export  of  training  to  the  field  pro- 
vides savings  in  student  salaries  and  TDY  costs  attributed  to  "resident" 
(USAFAS)  instruction.  Preliminary  Phase  1 course  estimates  provide  an  ave- 
rage of  75  lesson  hours  for  the  26  duty  positions  going  to  the  Fire  Direc- 
tion Course.  Using  the  assumptions  in  E.I.,  the  "average"  course  length  la: 

1.3  X (75  hours)  - 30  hours/week  *3.3  weeks 

Adding  1.7  weeks  for  the  cbm^And  post  exercise.  In-processing,  out-process- 
ing, and  graduation,  the  average  overall  course  length  Is  5 weeks.  Based  on 
the  current  Fire  Direction  Course  length,  this  is  an  average  potential 
savings  of  50-percerit.  ... 

The  total  student  coats  below, are'  based  on  the  minimum  essential  TACFIRE 
trained  positions  (Aubux. ^ to  .Appendix  3)  and  an  average  time  In  grade. 

Costs  are  based  on  FY76; salaries. 
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FI?.E  DIRECTION  COURSE  STUDF^n  SALARY/TDY 
IN  THOUSANTiS  OF  DOLLARS 

FY80  FY81  FY82  FY83  FY84  Fy85 

Platforni  Instructlcrv 

Costs  S999.9  Si, 171. 8 $1,553.0  $1,793.3  $1,749.3  $1,512.9 

Self  Paced  Instruc-  $469.4  $ 566.5  $ 739.9  $ 852.4'$  835.8  $ 727.1 
tlon 

Manyaar  Savings  33  38  51  59  57  49 

Potential  FY'  Savings  $530.5  $605.3  $813.1  $940.8  ’ $933.5  $785.8 

E . 3 . Fire  Support  Course  Savings. 

a.  Estir.ated  Instructor  Savings.  It  is  estimated  that  self-pacing,  modu- 
larity of  the  TACFIRE  instruction,  and  export'a'billty ,.  will  reduce  the  TACFIRE 
Instructor  requirements  for  the  Fire  Support  Course  by  24-48  percent.  For 
this  reason,  an  "average"  potential  savings  of  36  percent  has  been  used  in  the 
following  computations. 

FY78  FY79  FY80  FY81  FY82  FY83  FY84  FY85 

Required  Platform  2.0  2.6  6.3  6.3  6.3  9.5  6.3  6.3 

Instructors  from  Annex 
1 to  Appendix  D 

-36%  "average"  potential  2.3  2.3  2.3  3.4  2.3  2.3 

savings 

TOTAL  INSTRUCTORS  2.0  TTS  4To'  476  4.0^  6.1  aTO  O 

Tne  net  estimated  average  Instructor  savings  for  the  Fire  Support  Course 
based  on  self-pacing  and  exportability  to  the  field  are: 

FY78  FY79  FY80  FY81  FY82  FY83  FY84  FY85 

Estimated  Instructor  2.3  2.3  2.3  3.4  2.3  2.3 

Savings 

b.  Estimated  Student  Savln.qs.  In  addition  to  the  instructor  savings, 
the  reduced  Instruction"]  time  and  the  export  of  training  to-the  field  pro- 
vides savings  in  student  salaries  and  TDY  costs  attributed  to  ^'resident" 

(USAFAS)  instruction.  Preliminary  Phase  1 course  .estlmater.  provide  an  ] 

average  of  49  hours  in  E.I.,  the  "average"  course  length  is:  -I 

1.3  x (49  hours)  - 30  hours/week  ■ 2.1  week  j 

(Adding  .9  weeks  for  the  co..m;and  post  exercise,  In-procesalng,  out-processing,  I 

and  graduation,  the  average  overall  course  length  Is  3 weeks.  Based  on  the  I 


current  Fire  Support  Course  length,  this  is  an  average  potential  savings  qj 
25  percent. 

The  total  student  costs  Uelow.-are  based  on  the  minimum  essential  TACFIRe 
trained  positions  (Annex  2. to; Appendix  B)  and  an  average  time  In  grade. 
Costs  are  based  on  FY76  salaries. 

FIRE  SUPPORT  COURSE  STUDENT  SALARY/TDY 


IN  THOUSANDS  OF 

DOLLARS 

FY80 

FY81 

rY82 

FY83 

FY-84 

FY'SS 

Platform  Instruction 
Couta 

$192.4  ' 

'$2&9.7 

$256.9 

$406.4 

$ 363.6 

$ 342,5 

Self  Paced  Instruction 

$145.3 

$219.1 

$189.9 

$292.4 

$ 263.2 

$242.1 

Manyear 

Savings 

3 

5 

4 

7 

6 

6 

Potential  FY  Savings 

$47.1 

$80.6 

$67.0 

$ 114 . 0 

$100.4 

$100.4 

E . 4 . Equipment  Savings. 

As  a means  of  reducing'  the* requirements  for- TACFIRE  tactical  sets  for  train- 
ing a TACFIRE  Training  System  (TTS)  has  been  proposed  as  a part  of  the 
Individualized,  self;»*paced  .TACFIRE  Advanced  Training  Program  (subsections 
4.g.,  6.f.,  and  6.1.).  As  described  In  paragraph  6.f.,  two  TTS  (approximat- 
ely $6  M)  eliminate  the  need  for  a minimum  of  ten  tactical  sets  (approxi- 
mately $16-18  M) . In  addition,  the  self-paced  courseware  modules  to  be 
used  with  the  TTS  will  also  be  exportable  to  the  field  units  for  use  on  the 
tactical  equipment. 

E . 5 . Cost  Savings  Summary. 

a.  Estimated  Ing'traatpr.  Savings 


Fire  Direction 

Course 

FY78 

FY79 

FY80 

12.8 

FY81 

FY82 

O'?  Q 

rY83 

22.8 

FY84 

22.8 

FY85 

22.8 

lO  • 4 

44  • O 

Fire  Support 

Course 

7 A 

2.3 

2.3 

4 • J 

4 « J 

4 • J 

TOTAL  POTENTIAL 
INSTRUCTOR  SAVINGS 

15.1 

20.5 

25.1 

26.2 

25.1 

25.1 

(TOTAL  FY  SAVINGS 

184.1 

289.6 

339.9 

351.4 

339.9 

339.9 

IN  THOUSANDS  OF 
DOLl-ARS) 
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Estlnced  St’-.dc 

nt  Sevin 

11- 

Fire  Direction 
Course 

r{  80 
S530.5 

FY  81 
$605.3 

FY  82 
$813.1 

FY  83 
$940.8 

FY  84 
$913.5 

FY  85 
$785.8 

Fire  Support 
Couse 

$ A7.1 

$ 80.6 

$ 67.0 

$114.0 

$100.4 

$100.4 

TOTAL  POTENTIAL 
FY  SAVINGS  IN 
THOUSANDS  OF 
DOLLARS 

$577.6 

$685.9 

$880.1 

$1054.8 

$1013.9 

$886.2 

c.  Estir.ated  Total 

Potential  Savings. 

FY  80 

FY  81 

FY  82 

FY  83 

FY  84 

FY  85 

Instructor 

Savings 

$184.1 

$289.6 

$339.9 

$351.4 

$339.9 

$339.9 

Student 

Savings 

$577.6 

$685.9 

$880.1 

$1054.8 

$1013.9 

$886.2 

TOTAL  POTENTIAL 

$761.7 

$975.5 

$1220.0 

$1406.2 

$1353.8 

$1226.1 

FY  SAVINGS  IN 
THOUSANDS  OF 
DOLLARS 
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Annex  1 to  Appendix  E - Preliminary  Training  Matrix 
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ANNEX  3 TO  APPENDIX  E (cont  i nufcl) 

COST  DKVtLOPMKNT  MODF.I. 

TACURF  fire  direction  and  fire  support  COURSES 
Course  Start  Dates-FY80 
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APPENDIX  B 

SUMMARY  OF  GENERIC  DELIVERY  SYSTEM  CHARACTERISTICS 


B-1:  INSTRUCTOR  WITH  STANDARD  AIDS 

B-2:  PRINTED  MATERIALS 
B-3:  AUDIO  VISUAL 

B-4:  TRAINING  DEVICES  AND  SIMULATORS 
B-5:  COMPUTER-MEDIATED  TRAINING  SUPPORT 


The  general  capabilities,  advantages,  and  disadvantages  of  representative 
delivery  system  media  within  each  of  the  above  categories  are  summarired . A 
selected  mix  or  designed  configuration  of  specific  delivery  system  devices, 
software,  and  course  materials  will  not  necessarily  exhibit  the  same  capa- 
bilities or  constraints  as  these  generic  categories. 


This  material  supplements  information  presented  in  Section  5 of  this  report. 


Traditionally,  instruction  is  presented  to  the  student  by  an  instructor  in  a 
face-to-face  situation,  using  standard  instructional  aids  such  as  charts 
and  display  boards. 


' • 1.  Instructor.  The  instructor  presents  the  instructional  information, 

usually  in  lecture  form  and  in  a classroom  setting,  to  the  students, 
provides  opportunities  for  interaction,  clarification,  and  limited 
remediation.  Quality  of  instruction  may  vary  as  a function  of  the 
instructor's  abilities.  Costs  of  training  and  maintaining  instruc- 
tional staff  is  a major  factor  in  overall  program  costs.  A variant 
• on  this  technique  ia  peer  or  peer  group  instruction  wherein  selected 

students  assume  the  role  of  the  instructor  for  certain  purposes. 

2.  Charts  and  Display  Boards.  Wall  charts  are  pre-prepared  diagrams 
or  pictorials,  usually  on  paper,  cloth,  or  plastic  sheets,  for 
classroom  use.  Display  Boards  are  any  two-dimensional  medium  for 
the  display  of  non-projected  visuals;  they  include  large  writing 
surfaces  such  as  chalkboards  and  a variety  of  boards  to  which  display 
materials  can  be  attached. 


Both  charts  (if  the  surface  is  properly  protected)  and  display  boards 
permit  the  addition  of  illustrative  markings  during  the  presentation 
and  the  "building-up"  of  the  materials  at  a rate  and  manner  compatible 
with  student  learning.  Charts,  while  requiring  advance  preparation, 
are  generally  less  bother  while  being  used  than  projected  visuals 
(though  more  trouble  to  store  and  set  up)  and  can  be  made  any  ratio 
of  height  to  width.  Both  charts  and  display  boards,  while  relatively 
inexpensive  to  produce  and  adaptable  to  a variety  of  instructional 
settings  and  situations,  rely  heavily  on  the  availability  and 
effectiveness  of  a live  instructor  for  their  teaching  potential 
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3.  Overhead  Transparencies.  Overhead  transparency  projectors  enable  the 
projection  of  images  and  silhouettes  drawn  upon  various  sizes  of  clear 
acetate,  most  commonly  8"  x 10".  Some  projectors  permit  the 
simultaneous  projection  of  slides  (discussed  in  paragraph  2.2.3)  and 
transparencies.  They  can  be  used  in  settings  with  near-normal 
ambient  light  at  close  or  moderate  projection  ranges.  The  projector 
requires  the  proximity  of  an  operator  (usually  the  instructor)  for 
effective  use.  With  an  operator,  transparencies  offer  a flexible 
display  medium  by  stacking  and  overlapping,  covering  and  exposing 
portions,  etc.  Transparencies  are  relatively  easy  and  Inexpensive  to 
prepare,  the  full  range  of  still  photography  and  drafting  techniques 
may  be  used,  and  instruction  is  easily  modified  by  inserting  or 
deleting  tranparencies;  however,  the  projectors  and  transparencies 
are  cumbersome  to  move  and  store. 
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B-2;  PRINTED  MATERIALS 

Printed  materials  are  the  most  common  means  of  presenting  instruction  in  an 
individualized  or  self-study  mode  and  as  a supplement  to  other  forms  of 
instructional  media, 

1.  Standard  Printed  Materials.  Standard  printed  materials  include  text- 
books, workbooks,  pamphlets,  and  single  copy  sheets.  (Excluded  in 
this  category  are  programmed  instruction  texts  and  printed  materials 
used  in  simulation  exercises.)  Information  in  standard  printed 
materials  form  may  be  presented  in  words,  drawings,  or  photographs. 
Major  advantages  include  standardization  of  information  presented; 
ease  of  storage  and  use;  adaptability  to  student  self-pacing  and 
remediation;  low  cost  of  duplication  (Xerox)  or  reproduction  (if  done 
in  large  quantities);  and  high  adaptability  for  use  with  other 
instruc tional  media.  Major  disadvantages  include  heavy  reliance  on 
student  reading  ability;  time  and  cost  for  development;  not  easily^ 
modified;  and  lack  of  student  query/response  capability  (is  a one-way 
medium) . 

2.  Programmed  Instruction  Texts.  Programmed  Instruction  (PI)  texts 
differ  from  standard  printed  texts  primarily  in  the  organization  and 
presentation  of  the  instructional  materials.  In  PI  texts,  the 
subject  matter  is  systematically  organized  for  student  learning  in 
small  steps  or  frames;  each  frame  presents  a discrete  set  of  infor- 
mation and  then  poses  a question  to  which  the  student  is  to  respond. 
Two  types  of  texts  have  evolved.  The  first  is  in  a linear  format  in 
which  the  student  responds  to  all  steps  in  the  instructional  sequence. 
The  second  is  in  a branched  format.  In  this  format  the  student  is 
presented  a frame,  then  selects  an  answer  from  a multiple-choice 
question.  Depending  upon  the  answer  chosen,  the  student  is  directed 
to  the  next  instructional  frame  or  to  a set  of  remedial  frames. 
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Major  advantages  of  PI  texts  are  that  the  material  is  organized 
and  sequenced  in  a manner  designed  to  enhance  the  learning  process; 
learning  is  more  efficient  than  with  standard  text  materials;  each 
individual  progresses  at  his  own  pace,  in  keeping  with  his  mastery 
of  the  materials.  Major  disadvantages,  compared  to  standard  texts, 
include  the  time  and  costs  of  development;  organization  of  material 
discourages  independent  inquiry;  and  difficulty  in  using  for  reference. 


I 3.  Microform.  Microform  enables  the  storage  of  great  quantities  of 

printed  materials  in  a minimum  of  space  using  roll  microfilm, 

I microfiche,  or  aperture  cards.  Microform  viewers  are  used  to  view 

the  stored  information.  With  the  viewers,  various  techniques  are 
1 used  to  locate  and  retrieve  the  desired  data  from  the  mass  of  data 

I contained  on  the  roll  or  fiche.  Among  the  disadvantages  of  this 

I technique  are  viewer  fatigue,  specialized  and  complex  equipment 

required  for  production,  equipment  required  for  viewing,  and  various 
; format/viewing  device  incompatibilities. 


B-3:  AUDIO  VISUAL 

Audio,  audio-visual,  and  visual  media  may  be  used  in  a stand-alone  form  to 
present  instructional  sequences  or  as  a supplement  to  other  presentation 
media.  Pre-recording  ensures  a uniform  quality  of  presentation. 

1.  Audio  Tapes.  Tape  cassettes,  reels,  and  cartridges  provide  a simple, 
economic,  and  convenient  means  for  recording  and  presenting  instructional 
information  in  audio  form.  Tapes  are  strictly  linear  in  pacing  and 
control  except  for  manual  stop,  search,  and  replay.  Playback  units 

are  small  and  portable,  making  them  suitable  for  individual  student 
use  in  a variety  of  settings  and  for  providing  audio  instructions  for 
tha  performance  of  paced  manual  tasks.  Multi-track  and  random-access 
units  provide  limited  branching  capabilities.  Audio  tape  is  flexible 
for  editing,  erasure,  *and  re-use;  it  may  also  be  used  to  record 
student  responses  for  later  evaluation. 

2.  Slides  and  Sound-Slides.  Slides  provide  a film  transparency  with 
the  full  range  of  still  photography  techniques,  usually  35mm  in 

2"  X 2"  mounts;  slide  presentations  normally  employ  slide  magazines 
of  varying  capacities,  with  the  presentation  rate  under  manual  or 
automatic  control.  Sound-slide  presentations  use  integrators/ 
synchronizers  to  integrate  tape  recorders  with  slide  projectors.  Some 
projectors  permit  the  presentation  to  be  stopped  while  the  student 
performs  a task,  practices  a skill,  does  a workbook  exercise,  or 
answers  a question.  Special  responder  devices  are  available  which 
enable  presentation  re-start  when  a correct  response  has  been  given 
by  the  student;  random-access  units  permit  selective  review  or 
branching  for  individual  or  group  presentations. 

Slides  permit  ease  of  program  rearrangement  or  update,  whereas 
sound-slide  fixes  the  display  time  and  limits  the  ease  of  program 
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redesign.  A particular  problem  encountered  in  the  use  of  sound- 
slide  presentations  is  the  loss  of  synchronization  between  the  visual 
and  sound  segments  unless  a pulsing  technique  is  used  to  maintain 
proper  synchronization,  particularly  during  rewind  and  fast-forward 
operations.  Slide  and  sound-slide  units  are  relatively  portable  and 
little  space  is  required  for  media  storage. 

Filmstrips  and  Sound-Filmstrips.  Filmstrip  projectors  permit  the 
projection  of  a still  series  of  color  or  black-and-white  pictures. 

They  may  use  35mm  motion  or  slide  film,  16mm  or  8mm  film  cartridges, 
or  continuous  loop  filmstrips.  Audio  may  be  incorporated  by  discs 
or  audio  tape  cassettes  with  audio  program  synch  and  control  signals. 
While  the  instructional  sequence  is  fixed,  the  presentation  time  is 
under  operator  control. 

Filmstrips  offer  the  full  range  of  photographic  techniques,  ease  of 
storage  and  handling,  and  production  gear  is  easy  and  inexpensive 
to  use.  Sound-filmstrip  production  requires  special  equipment,  with 
the  control  signals  and  sound  track  programmed  independent  of  the 
film.  Modifying  a visual-audio  sequence  is  not  easy  and  combining 
sound  with  filmstrip  usually  eliminates  the  picture  "freeze" 
capability.  There  is  no  inherent  or  readily  adaptable  student 
response  capability  with  filmstrips. 

Motion  Pictures  and  Sound  Motion  Pictures.  Motion  pictures  can  provide 
continuity  of  action,  an  illusion  of  motion,  slow-motion,  control  of 
demonstration  speed  or  aspect  angle,  time-lapse  action,  time  compression, 
and  timed  focus  on  an  event  when  such  features  are  important  to  a 
training  requirement.  Formats  are  usually  16tnm,  8mm,  or  super-8. 

Sound  is  incorporated  using  magnetic  or  optical  sound  tracks. 
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Cartridge  projectors  offer  simplicty  of  operation  and  longer  film 
life  then  do  reel-to-reel  projectors.  Films  lack  a student  response 
and  scoring  capability  (unless  with  programmed  or  facilitator-control 
stop  and  student  response  sheets),  require  darkness  for  presentation, 
provide  displays  at  a fixed  rate  for  all  viewers,  and  are  comparatively 
expensive  to  produce  and  update. 

Television  and  Video  Recordings.  This  category  includes  live  tele- 
vision, slow-scan  television,  and  video  recording/playback.  Live 
television  may  be  used  in  the  instructional  setting  to  observe  an 
event  at  a distance,  to  provide  magnification  or  focus  on  a particular 
aspect  of  the  learning  activity,  and  to  present  the  information  to 
a large  or  geographically  remote  audience.  The  activities  may  be 
recorded  fbr  immediate  or  delayed  playback.  Recorded  actions  and 
materials  can  be  displayed  at  various  speeds,  stopped  or  reversed, 
and  preprogrammed  material  is  readily  edited  and  corrected. 

Instructional  television  (ITV)  normally  refers  to  the  presentation  of 
preprogrammed  material  controlled  from  a central  location.  Slow 
scan  television  is  a technique  that  permits  a more  efficient  use  of 
transmission  capabilities  by  sending  a lesser  number  of  pictures  per 
unit  of  time.  Video  recording  and  playback  also  permits  the  presenta- 
tion of  the  instuctional  material  under  local  control:  the  program 
is  recorded,  either  at  the  central  location  or  locally,  and  scored 
for  later  presentation  or  playback  equipment  at  the  local  site. 
Currently,  video  tape  in  reel  or  cassette  form  is  used  as  the 
principal  recording  medium.  Video  disc  recording  is  a recent  develop- 
ment which  permits  the  recording  and  storage  of  extensive  amounts  of 
information  in  video  format  in  a verv  limited  space  (i.e.,  on  the 
video  disc)  for  later  playback. 


B-11 


f 

B-4:  TRAINING  DEVICES  AND  SIMULATORS 


Major  training  devices  and  simulators  are  used  primarily  where  the  subject 
matter  is  too  complex  for  verbal,  symbolic,  or  simple  pictorial  presentation, 
or  requires  extensive  hands-on  practice  for  proper  skills  development. 

!•  Teaching  Machines.  Teaching  machines  refer  to  a variety  of  devices 
which  present  instruction,  require  responses,  and  act  on  the 
responses  given.  Some  may  be  simple  portable  devices  while  others 
use  or  combine  various  forms  of  presentation  such  as  audio,  slides, 
video,  film-strips,  or  even  computer-assisted  instruction.  They 
tend  to  be  special  purpose  machines,  with  attendant  problems  of 
operation,  maintenance,  and  cost  of  software  (instructional  materials 
and  presentation  control  programs)  development.  A major  advantage 
is  that  they  control  the  information  presented  to  the  student,  prevent 
skipping  of  materials,  and  adapt  the  presentation  pace  to  the 
individual  student.  They  generally  require  overt  responses  from  the 
student  and  many  have  automatic  scoring  capabilities. 

2.  Models  and  Mock-Ups.  Models  and  mock-ups  are  three-dimensional 
representations  of  objects  which  differ  from  the  real  object  in  size, 
material,  and/or  functional  capability.  They  may  be  constructed  in  a 
manner  which  permits  easy  disassembly  or  may  be  made  of  transparent 
materials  so  that  the  student  may  see  internal  components  and  their 
physical  and  functional  relationships.  Their  most  frequent  use  is 

to  illustrate  both  static  and  dynamic  spatial  relationships. 

3.  Hardware  Simulator-Trainers.  Equipment  simulator-trainers  are  used  to 
train  personnel  in  tasks  such  as  operations,  emergency  procedures,  and 
maintenance  of  the  operational  system.  They  may  be  designed  for 

part  task,  full  task,  individual,  team,  or  total  system  training  or 
any  combination  thereof.  They  can  be  designed  to  provide  control 
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over  training  by  incorporating  instructor  monitoring  of  student 
actions  and  cues,  situational  "freezes"  and/or  recording  so  that 
specific  student  behaviors  can  be  critiqued  in  depth.  They  are  also 
designed  so  that  personnel  and  equipment  can  be  protected  from  the 
consequences  of  erroneous  behavior.  They  may  cost  anywhere  from  a 
fraction  to  several  times  the  cost  of  the  equivalent  operational 
equipment . 

4.  Actual  Ob.jects.  An  actual  object  (component,  assembly,  unit,  or 
system)  may  be  used  as  a training  device  or  instructional  medium. 

For  this  purpose,  two  broad  classes  of  actual  objects  are  generally 
identified:  in-context  and  out-of-context.  In-context  objects  are 
those  located  in  and  used  for  mission  performance  in  the  operational 
setting;  they  provide  the  principal  medium  for  on-the-job  training. 

The  use  of  in-context  objects  for  instructional  purposes  may  Interfere 
with  on-going  operations  and  present  hazards  to  personnel  and  equip- 
ment. The  principal  advantages  are  high  transfer  of  training, 
motivation,  and  the  accomplishment  of  productive  work.  Out-of -context 
objects  are  those  dedicated  for  training  use  and  are  usually  in 
excess  of  those  required  by  the  operational  mission.  Compared  to 
in-context  objects,  their  use  generally  offers  more  favorable 
circumstances  for  training  and  better  control  of  the  learning 
situation. 


I 
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B-5:  COMPUTER-MEDIATED  TRAINING  SUPPORT 

The  computer  may  be  used  to  present  individual  instruction  and  practice,  for 
team  exercise,  and  to  manage  the  presentation  of  instruction.  As  an  instructional 
medium,  the  computer  can  be  programmed  to  present  instructional  materials, 
interact  with  the  student,  record  and  analyze  responses,  and  adapt  the  instruc- 
tional sequence  based  on  the  cumulative  trend  of  a student's  responses. 

1.  Computer  Managed  Instruction  (CMI) . In  this  mode,  student  learning 
performance  data  (usually  test  results)  are  entered  into  the  computer 
via  any  of  a number  of  possible  data  entry  devices.  The  computer 
aggregates  and  scores  the  trainee  performance  in  keeping  with  the 
learning  objectives  and  standards,  evaluates  the  results,  and  pre- 
scribes the  next  set  of  learning  activities.  The  computer  maintains 
a cumulative  record  of  student  performance  and  learning  prescriptions 
and  provides  a printout  of  this  information  periodically  or  on  request. 
Instead  of  the  testing  taking  place  off-line  for  subsequent  processing 
and  entry  into  the  computer,  the  program  may  also  be  designed  for 
interactive  computer  presentation  of  the  test  materials  and  immediate 
assignment  of  the  next  learning  activity.  This  on-line  CMI  requires 
similar  media  capabilities  as  CAI,  below. 

2.  Computer  Assisted  Instruction  (CAI).  In  this  mode  the  instructional 
materials  are  presented  by  the  computer,  usually  via  a cathode  ray 
tube  (CRT)  or  teletypewriter.  The  student  interacts  with  the  computer 
via  a keyboard  or  light  pen.  Responses  are  scored  and  evaluated,  and 
decision  rules  Incorporated  in  the  instructional  program  are  used  to 
determine  instructional  sequencing  and  performance  feedback. 
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3.  Computer-Based  Team  Training.  Team  or  system  training  may  also  be 
accomplished  on-computer,  using  inputs  either  from  a pre-stored 
instructional  data  tape  or  from  real  time  computer  interaction  with 
the  operational  environment.  These  inputs  may  be  combined  with  other 
preprogrammed  messages,  synchronized  to  geographic  and  time  referents, 
for  presentation  to  a number  and  variety  of  positions  undergoing 
simultaneous  training.  Trainees  respond  with  control  actions  as 
they  would  in  live  operations. 

A principal  advantage  of  CAI  is  that  it  can  approximate  human  instructor 
capabilities  (including  interaction,  response  monitoring,  and  adaptive  strat- 
egies) while  maintaining  standardization  and  quality  of  instruction.  Disad- 
vantages may  include  high  initial  development  costs;  software  and  hardware 
complexity  and  associated  maintenance  requirements;  and  the  need  for  additional 
skills  (computer  programming)  beyond  subject  matter  expertise  for  program 
development.  The  initial  acquisition  costs  may  be  relatively  low  if  machine- 
transf errable  software  is  used  (such  as  the  PLANIT  CAI  system)  rather 
than  a system  wedded  to  a specific  computer  or  interactive  terminal  device. 

Two  advantages  of  computer-based  delivery  systems  include:  (1)  automated 
recording,  update,  and  listing  of  student  records;  (2)  efficiency  of  course- 
ware (tests,  lessons,  simulations)  data  base  update.  The  second  advantage 
is  particularly  true  with  an  interactive  compiler  CAI  system  and  a text  editor, 
such  as  the  configuration  accessible  by  USAFAS  on  the  UNIVAC  1108. 
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APPENDIX  C 

PROCEDURES  AND  FORMS  SUPPORTING  UNIT  CAI  IMPLEMENTATION 


C-1:  PROCEDLTIES  FOR  RUNNING  PLANIT 

C-2:  QUESTIONNAIRE(S) 

C-3:  MONITOR'S  OBSERVATION  LOG 
C-4:  CAI  ATTITUDE  QUESTIONNAIRE 

These  materials  are  intended  to  supplement  the  instructions  and  the  automated 
record  examples  presented  in  Section  6 of  this  report. 


Cue  or  Display 


Your  Action 


Comnent 


G 


CRT  screen  lights 
Printer  Hums 
High  pitched  tone 
CRT  carrier  light  ON 

Edgewood  Arsenal,  etc. 

(appears  on  CRT  screen) 


ICONNECT  CONSOLE  TO  COMPUTER 

Obtain  authorized  UNIVAC  & 
PLANIT  identifiers 

Turn  CRT  power  switch  ON 
Press  CONV  Mode  key 

Press  print  line  button 
Dial  (phone  number) 

Place  phone  in  coupler 

Key  #ARI05  or  ARI06 
Press  NEW  LINE  key  (NL) 


- to  activate  CRT  and  keyboard 

- puts  console  in  interactive 
mode 

- to  activate  printer 

- to  get  computer  channel 

- to  permit  data  transfer 

- Identifies  your  console 
••  transmits  to  computer 

- you  are  on-computer 


@ 


DATEiDDMMTf  TIME:HHMMSS 
e.g.,  130277  074530 

>appears  on  screen 


IDECLARE  JOB  TO  EXECUTIVE  SYSTEM^ 

key  gRUN ( space ) name. accountnumber. 58. 408 

e.g.  gRUN  NYSTROM. accountnumber .50.488 
Press  NEW  LINE  key  (NL) 

key  ggCQUE  (NL)  > will  no  longer  appear 


Incorrect  typing 


I 

CORRECT  KEYING  ERRORS  BEFORE  COMPUTER  ENTRY  ! 


Hold  CONTROL  key  down  and 
then  press  X key  (before 
pressing  NEW  LINE  key) 


to  override  keyed  line 
before  transmit  to  computer 
computer 


jCursor  jumps  to  next  Key  new  replacement  line  transmit  corrected  entry 

jlina,  left  margin  of  (NL) 

; screen 


Cue  or  Display 


Your  Action 


Comnents 


© 


String  of  READY  messages 
ending  with:  LOGIN  OR  END 

* 


ENTER  COMMAND 

* 

ENTER  SYSTQ)  COMMAND 


I ACCESS  PLANITi 

@ADD  PLAN1T*PRUNS.H0T  (NL)  - to  load  PLANIT 

(PLANIT  loaded) 

Key  Identifier  (ML)  ‘prompts  response 

e.g.,  NYSTROM  (NX) 

4 SYSTEM  (NL)  - to  PLANIT  System  Mode 

(System  Mode  prompt) 


© 


i ADDLOG  STUDENT  NAMES  ■ 


* 

ENTER  SYSTEM  COMMAND 

* 


4 SYSTIM 

ADDLOG/student  identification/ (NL) 
e.g..  ADDLOG /SmIthTjONESTInlI 


DONE 

A 


- To  access  system  command 

- To  enter  student 
Identifications. 

- Multiple  student  ID's 
can  be  added  on  a 
single  line  separated 
by  slashes. 

- Student  ID  has  been 
accepted  by  PLANIT 


I RETRIEVE  AND  EXECLTE  CAI  LESSON  AS  A STL’PEN:' 


GET  lessonname  (NL) 
e.g., GET  INTRO  (NL) 


- use  PLANIT  lesson 
name  (para.  B3a) 


Student  Identifier  (NL) 
e.g., SMITH  (NL) 

Lesson  Executes 
(Frames  are 
administered  and 
appear.  Successive 
responses  are  cued 
by  *) 


- use  identifier  of 
student  (from 
Step  4 ADDLOG) 
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Cue  or  Display  Your  Action  Comments 

0 I RETRIEVE  AND  EXECITTE  CAI  LESSON, 

I as  an  AUTHOR I 


GET  lessonname  - use  PLANIT  lesson  name 

e.g.,GET  INTRO 

IDENTIFY  YOL’RSELF*** 

Author Identifier  (NL) 
e.g.,JOHN  (NL) 

ENTER  COMMAND 

* 

CLEAP  (NL) 

DONE 

EX  (NL) 

(Lesson  frames  are 
administered  and  appear 
in  sequence  as  student 
would  see  them. 

Successive  responses 
are  cued  by  *) 

* &CL£AR,EX  (as  above)  - to  re-execute 

* Sign-off  PLANIT  when  finished  - See  Sign-Off  procedure 

(t)and(f) 


- author  access  requested 

- PLANIT  awaits  author  control 

- to  clear  prior 
execution  'ecord 


- to  run  lessoi  jm  the 
start 


© 

(After  retrieving 
CAI  lesson  with 
GET  and  author 
identifier,  Step 

ENTER  COMMAND 


DONE 

* 

SUMMARY  ONLY  (Y/N)? 

* 

(record  printed  as 
requested) 

* 


I OBTAIN  STUDENT  RECORDS  I 


ATTACH  studentname  (NL) 

DISPLAY  (NL) 

V (NL) 

N (NL) 


- use  name  student  Issued 
to  get  lesson 

- display  student  record 

- summary  data  only 

- complete  record  printed 


a 
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Cue  or  Display 

vS/' 

Your  Action 

Connencs 

ENTER  COMMAND  OR  * 

SIGN  OFF  PLANIT 

SYSTEM  (NT.) 

- Enter  System  Mode 

DONE 

* 

QUIT  ALL  (NL) 

Exit  PLANIT 

PLANIT  SYSTEM  SIGNING 

OFF 

CD 

iSIGN  OFF  THE  COMPUTER 

0FIN 

- terminate  session 

Display  accounting 
Information  then 
TERMINAL  INACTIVE 

HOLD  DOWN  CONTROL  KEY 

Chen  press  D 

- disconnect  phone 
line 

carrier  light  goes  out 

Hang  up  phone,  depress 
power  key  on  CRT 

- Turn  off  CRT 

CRT  goes  to  black 

Depress  power  key  on 
printer 

- Turn  off  printer 

(D 

1 RESTORE  PLANIT  : 

I 

SADD  PLANIT*PRUNS. RESTORE 

- Restore  PLANIT  to  i 
reliable  operating  { 
status  I 

Facility  warnings, 
blocks  copied 

1 

READY 

FURPlTRs, 

READY s 

• 

9ADD  PLANIT4PRUNS.HOT 

- Access  PLANIT  after' 
restore  i 

j 

i 

LOGIN  OR  END 

1 

- PLANIT  is  up 

* 


Note:  Obtain  all  PLANIT  student  records  required 
before  restoring  system. 


I 


. ENTER  COMMAND  OR*  SYSTQl  - Access  syscea  conanands 

ENTER  SYSTEM  COMMAND 


LIST  $TOC  - List  cable  of  contents  : 

of  lessons  available  < 
in  PLANIT 


I (concents  listed) 
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Date : 


QUESTIONNAIRE (S) 


Grade 


Duty  Position_ 


GCT  Score 


Education 


1.  How  long  have  you  been  in  the  Army?  

2.  Have  you  had  previous  military  service?  Yes  No 

3.  When  did  you  complete  BCT  (date)  

4.  Are  you  currently  in  Advanced  Individual  Training  (AIT)?  Yes 


5.  Have  you  had  Land  Navigation  (Map  Reading)?  Yes 

6.  Can  you  read  a military  map?  Yes  No  


APPENDIX  C-4 

CAI  STUDENT  ATTITUDE  QUESTIONNAIRE 
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CAI  STUDENT  ATTITUDE  QUESTIONNAIRE 


NAME  AND  GRADE 
UNIT 


SSAN 


PHONE 


DATE 


1.  What  did  you  think  of  the  Observed  Fire  CAI  Lessons  that  you  have  just  completed? 


2.  My  attitude  toward  CAI  material  was  that  I... 

( ) disliked  it  very  much 
( ) disliked  it 

( ) neither  liked  nor  disliked  it 
( ) liked  it 
( ) liked  it  very  much 

3'  Instructions  for  taking  the  lessons  were... 

( ) very  difficult  to  understand 
( ) difficult  to  understand 
( ) borderline 
( ) easy  to  understand 
( ) very  easy  to  understand 

4.  Which  Observed  Fire  CAI  Lessons  did  you  take?  (check) 

Determination  of  Direction 

Target  Location:  Polar  Plot  Method  and  Grid  Coordinates  Method 

Locate  a Target  by  Shift  from  a Known  Point 

The  Call  for  Fire 

The  Adjustment  of  Fire  by  the  Bracketing  and  Creeping  Methods,  Part  I 

The  Adjustment  of  Fire  by  the  Bracketing  and  Creeping  Methods,  Part  II 


\ 

'i 


.1 ; 
r ' 


4 i 

41 


6.  Tlie  lessons  covered  the  areas  listed  in  (4)  above.  Were  any  of  these,  or 
parts  of  these,  particularly  good,  and  tell  why. 
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8.  I think  that  this  CAI  method  of  instruction/learning  is... 

( ) very  effective 
( ) effective 
( ) borderline 
( ) ineffective 
( ) very  ineffective 

9.  For  satisfactory  understanding  of  the  subject  being  studied,  the  amount 
of  time  provided  was: 

( ) much  too  long 
( ) fairly  long 
( ) about  right 
( ) fairly  short 
( ) much  too  short 

10.  For  satisfactory  understanding  of  the  subject  being  studied,  the  amount  of 
material  (information)  provided  was: 

( ) much  too  large 
( ) fairly  large 
( ) about  right 
( ) fairly  small 
( ) much  too  small 

11.  The  technical  detail  provided  was: 

( ) very  satisfactory 
( ) satisfactory 
( ) borderline 
( ) unsatisfactory 
( ) very  unsatisfactory 


i 


very  satisfactory 

satisfactory 

borderline 


unsat is tac  tory 
very  unsatisfactory 


My  understanding  of  the  material  presented  was 


very  satisfactory 
satisfactory 
borderline 
unsatisfactory 
very  unsatisfactory 


The  qijantity  of  the  off-line  course  exhibits  provided  was 


very  satisfactory 
satisfactory 
borderline 
unsatisfactory 
very  unsatisfactory 


5.  Were  any  of  the  exhibits  inaccurate? 


6.  Were  any  of  the  exhibits  irrelevant  or  unnecessary 


( ) Yes  ( ) No  If  Yes,  which? 


Can  you  think  of  any  other  exhibits  that  should  be  added  to  the  set? 
( ) Yes  ( ) No  If  Yes,  please  describe: 


If  you  had  to  carry  out  the 

how  well  could  you  do  them? 

tasks 

on  observed  fire  covered  in  the  course 

( ) 

very  effectively 

( ) 

effectively 

( ) 

borderline 

( ) 

ineffectively 

( ) 

very  Ineffectively 

Have 

you  ever  had  this  type 

(CAI) 

training  before? 

( ) 

Yes  ( ) No 

Does 

this  type  of  training  make  Army  instruction  better? 

( ) 

Yes  ( ) No 

21.  Is  this  type  of  training  interesting  to  you? 
( ) Yes  ( ) No  ( ) Not  Sure 
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ABACUS 

ACB 

ADDS 

ADO 

AQB 

AR 

ARI 

ARMCOM 

ARTADS 

ARTEP 

ASARC 

ATSC 

Bn 

CAI 

CAMMS 

CATTS 

CEP 

CFP 

CMI 

CODAP 

COEA 

CP 

CTEA 

DA 

DARCOM 

DCSOPERS 

DCSPERS 


ABBREVIATIONS 


Experimental  Army  Computerized  Training  System  (CTS) 
project  underway  at  Army  Training  Support  Center  and 
U.S.  Army  Signal  School 

Army  Classification  Battery 

Applied  Digital  Data  Systems 

Air  Defense  Officer 

Army  Qualification  Battery 

Army  Regulation 

U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences 

U.S.  Army  Armament  Command 

Army  Tactical  Data  Systems 

Army  Training  and  Evaluation  Program 

Army  Systems  Acquisition  Review  Council 

Army  Training  Support  Center 

Battalion 

Computer  Assisted  Instruction 
Computer  Assisted  Map  Maneuver  System 
Computer  Assisted  Tactical  Training  System 
Concept  Evaluation  Plan 
Concept  Formulation  Package 
Computer  Managed  Instruction 

Computerized  Occupational  Data  Analysis  Programs 
Cost  and  Operations  Effectiveness  Analysis 
Command  Post  Exercise 

Cost  and  Training  Effectiveness  Analysis 
Department  of  the  Army 

U.S.  Army  Development  and  Readiness  Command 
Deputy  Chief  of  Staff,  Operations 
Deputy  Chief  of  Staff,  Personnel 
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DEVTOS 
Div  Arcy 
DP 

DRAGON 

DT 

DT/OT 


Developmental  Tactical  Operating  System 
Division  Artillery 
Development  Plan 

An  Anti-Tank  Missile  Weapons  System 
Developmental  Testing 
Developmental  Test/Operational  Test 


ECOM 

EPMS 

£T 

ETM 


U.S.  Army  Electronics  Command 
Enlisted  Personnel  Management  System 
Embedded  Training 
Extension  Training  Materials 


FADAC 

FDC 

FEA 

FM 

FORSCOM 

FTX 


Field  Artillery  Data  Analysis  Computer 

Fire  Direction  Center 

Front  End  Analysis 

Field  Manual 

U.S.  Army  Forces  Command 

Field  Training  Exercise 


ICH 

I-G-L-M 

ILS 

INTEL 

IOC 

IPISD 

IPR 

LSD 

ITDT 


Instructor  Contact  Hours 

Institutional,  Garrison,  Local,  Major  (training  areas) 

Integrated  Logistics  Support 

Intelligence 

Initial  Operational  Capability 

Interservice  Procedures  for  Instructional  Systems  Development 

In-Process  Review 

Instructional  Systems  Development 

Integrated  Technical  Documentation  and  Training 
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JPA 

JPG 

JPM 


Job  Performance  Aid 
Job  Performance  Guide 
Job  Performance  Manual 


LAI 

LAW 

LCSMM 

LDA 

LET 

LOA 

LR 

LRIP 

LSA 


Lesson  Administrative  Instructions 
Light  Anti-Tank.  Weapon 
Life  Cycle  System  Managemertt  Model 
Lesson  Design  Approach 

Launch  Effects  Trainer  (for  DRAGON  system) 

Letter  of  Acceptance 

Letter  Requirement 

Low-Rate  Initial  Production 

Logistic  Support  Analysis 


>UGLAD 

MASSTER 

MILES 

MILPERCEN 

MMC 

MOS 

NET 

ODP 

OJT 

OPMS 

OT 

OTEA 

PI 

PLANIT 

PLATO 

POI 


Marksmanship  and  Gunnery  Laser  Devices 

Modem  Army  Selected  Systems  Test,  Evaluation,  and  Review 

Multiple  Integrated  Laser  Engagement  System 

Military  Personnel  Center 

U.S.  Army  Maintenance  Management  Center 

Military  Occupational  Speciality 

New  Equipment  Training 

Outline  Development  Plan 
On-The-Job  Training 
Officer  Personnel  Management  System 
Operational  Testing 

U.S.  Army  Operational  Test  and  Evaluation  Agency 
Programmed  Instruction 

Programmed  Language  for  Interactive  Teaching 
Programmed  Logic  for  Automated  Teaching  Operation 
Program  of  Instruction,  Plan  of  Instruction 
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QQPRI 


Qualitative  and  Quantitative  Personnel  Requirements 
Information 


RDTE 

REALTRAIN 

ROC 


Research,  Development,  Test  and  Evaluation 
Simulation  System  for  REAL ism  of  TRAINing 
Required  Operational  Capability 


SCOPES 

SDC 

SG 

SIDPERS 

SLS 

SM 

SOJT 

SOW 

SP  ARTY 
SQT 


Squad  Combat  Operations  Exercise,  Simulated 
System  Development  Corporation 
Student  Guide 

A FORSCOM  Computerized  Personnel  Data  and  Training  Status 
System  (FORSCOM  Circular  350-8) 

Student  Lesson  Sheet 

TRADOC  System  Manager 

Structured  On-the-Job  Training,  Supervised  On-the-Job 
Training 

Statement  of  Work 
Special  Artillery 
Skill  Qualification  Test 


TACFIRE 

TARCOM 

TASA 

TASO/TASC 

TC 

TDI 

TDR 

TEC 

TEWTS 


Tactical  Fire  Direction  System 

U.S.  Army  Tank-Automotive  Command  (DARCOM) 

Task  and  Skills  Analysis 

Training  Aids  Service  Office/Training  Aids  Service  Center 
Training  Circular 

Training  Developments  Institute,  Army  Training  Support 
Center  (formerly  TMI) 

Training  Device  Requirement 
Training  Extension  Course 
Tactical  Exercise  Without  Troops 
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TM 

TMG 

TMI 

TOW 

TRADE 

TRADER 

TRADOC 

TRASANA 

TSM 

USACGSC 

USAFAS 

USAIS 

USAREUR 

W’BS 


Technical  Manual 

Training  Management  Guide 

Training  Management  Institute  (see  TDI) 

A Heavy  Anti-Tank/Assault  Weapon  System 

Training  Devices  Command  (DARCOM) 

Training  Devices  Requirements  Directorate  of  Army 
Training  Support  Center,  TRADOC 

U.S.  Army  Training  and  Doctrine  Command 

TRADOC  Systems  Analysis  Activity 

TRADOC  System  Manager 

U.S.  Army  Command  and  General  Staff  College  (Ft.  Leavenworth) 
U.S.  Army  Field  Artillery  School  (Ft.  Sill) 

U.S.  Army  Infantry  School  (Ft.  Banning) 

U.S.  Army,  Europe 

Work  Breakdown  Structure 


The  six  sections  have  presented  a preliminary  frame  of  reference  and 


decision  model  for  TEC  delivery  systems  concept  planning  In  the  FY  78-83 
period.  Specifically; 

• background,  purpose,  assumptions,  and  objectives. 

• Implication  of  Army  Initiatives  and  directives  forecasted  to 
Impact  training  evaluation  resources  utilization  at  USAFAS 
during  FY  78-83. 

• an  overall  model  of  the  selection,  constraint,  and  solution 
factors  normally  Influencing  Army  training  program  delivery 
system  decisions  with  a description  of  how  five  program 
development  situations  viewed  as  USAFAS  requirements  In 

FY  78-83  will  differ  on  these  factors. 

• a preliminary  delivery  systems  selection  process  Incorporating 
four  delivery  system  decision  stages  keyed  to  the  events, 
available  data,  and  products  needed  to  Integrate  Individual- 
collective  training  and  evaluation  within  a material  system 

or  MOS  life-cycle  proponency  model. 

• a summary  of  delivery  systems  available  or  potentially  available 
to  support  USAFAS  and/or  unit  training  during  FY  78-83. 

• a methodology  for  exporting  the  observed  fire  CAI/TEC  package, 
developed  by  USAFAS,  to  the  field. 

V 

This  section  provides  a work  plan  to  further  define,  develop,  and  evaluate 
the  frame  of  reference  and  decision  process  In  the  six  referenced 


sections 
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A. 


OBJECTIVES 

1. 


Obtain  USAFAS/ARI  concurrence  and  revisions  to  the  problem  definition 
and  preliminary  delivery  systems  selection  plan  contained  in  Sections  2 
through  5 (Step  1 in  work  plan  detailed  below). 


2.  Further  detail  and  develop  the  delivery  systems  selection  procedures, 
define  specific  data  sources,  and  specify  products  which  incorporate 
Army  priorities  (Step  2 in  work  plan  detailed  below) . 

3.  Pilot  test  the  application  of  the  delivery  systems  selection  procedures 
in  an  appropriate  training  program  development  activity  at  USAFAS; 
gather  data,  evaluate  the  procedure,  and  revise  components  in  accordance 
with  findings  (Step  3 in  work  plan  detailed  below). 

B.  SCOPE  OF  WORK 

Steps  of  the  workplan  conform  to  the  three  objectives  and  are  discussed  below. 

1.  Step  1 - USAFAS/ARI  Review.  Revisions,  and  Concurrence  on  Approach 

The  purpose  of  this  step  is  to  obtain  USAFAS/ARI  review,  recommenda- 
tions, and  requirements  for  the  framework,  approach,  and  process  set 
forth  in  prior  sections  of  this  report.  This  will  require  meetings 
with  ARI  and  Ft.  Sill  personnel  to  coordinate  working  assumptions, 
obtain  priority  requirements  and  guidance,  and  gather  data.  Because 
the  preliminary  delivery  systems  decision  process  concerns  decision 
stages  (see  Section  4)  that  integrate  work  from  combat,  training, 
and  course  developers  it  is  suggested  that  USAFAS  review  consider 
such  inputs,  as  well  as  those  from  any  TRADOC  System  Managers  and 
the  Resource  Manager.  The  best  coordination  point  within  USAFAS  may 
be  Course  Design/Development,  because  this  appears  to  be  the  focal 
point  for  finalizing  delivery  system  decisions  at  USAFAS.  An  additional 


purpose  for  visiting  ARI  will  be  to  obtain  their  priorities,  suggested 
data  sources,  or  instruments  for  determining  trainee  characteristics 
data  useful  to  selecting  (or  assigning)  appropriate  delivery  systems 
mix,  including  but  not  limited  to  cognitive-perceptual  style  indices. 
These  meetings  should  take  place  within  the  first  month  of  a six-month 
workplan,  such  that  revisions  and  specific  inputs  will  be  available 
for  Step  2 by  the  end  of  the  first  month.  This  report  (TM-5841/001/00) 
will  be  modified  or  supplemented  as  required  to  incorporate  USAFAS/.\RI 
priorities  .* 

2 . Step  2 - Develop  Delivery  Systems  Selection  Procedures 

The  purpose  of  this  step  is  to  define  and  detail  requirements,  decision 
criteria,  data  sources,  and  products  of  the  delivery  systems  selection 
process  based  upon  USAFAS  needs  and  emerging  DA/TRADOC  directives, 
specifications,  and  delivery  systems.  Suggested  tasks  include: 

2.1  Determine  System,  MOS,  and  Trainee  Focus 

The  purpose  of  this  task  is  to  define  those  combat  missions, 
systems,  jobs,  and  enlisted/officer  MOS  and  skill  levels  of 
priority  interest  to  USAFAS  regarding  trainee  data  and  delivery 
systems.  Suggestions  already  advanced  by  USAFAS  include:  courses 
scheduled  to  go  self-paced  such  as  C&E,  Gunnery,  and  Counterfire; 
MOS  13F  (Fire  Support  Specialist)  because  it  will  have  the  dual 
problem  of  resident  training  and  cross-training  of  MOSs  (13E, 

13F,  13W)  in  the  field,  as  well  as  a good  range  in  types  of 
individual-team  tasks;  or  re-development  of  the  FA  Officer  Basic 
Course  for  Cannon,  Target  Acquisition,  Pershing,  and  Lance  oper- 
ations. This  task  interacts  with  the  first  task  of  Step  3 and 
provides  input  to  other  tasks  below. 

Considerations  for  Step  1 are  also  given  in  Section  7 (B.l  - B.5). 
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2.2  Decermine  Individual-Collective  Task.  Characteristics 

The  purpose  of  this  task  is  to  define  the  essential  descriptors 
for  types  and  levels  of  performance-oriented  subject  matter 
which  are  compatible  with  system-job,  MOS,  and  trainee  data 
source  decisions  made  in  Task  2.1. 

2.3  Determine  Essential  Attributes  of  Delivery  Systems 

This  task  extends  and  prioritizes  the  work  started  in  Section  5 
and  Appendix  B of  this  report.  The  purpose  is  to  determine  thos 
generic  individual-collective  training  and  evaluation  delivery 
system  (methods-media)  and  specific  Field  Artillery  delivery 
system  configurations  of  priority  interest  to  USAFAS.  This 
decision  relates  to  decisions  made  in  tasks  2.1  and  2.2. 

The  intent  is  to  define  those  attributes  of  delivery  systems 
essential  for  matching  with  trainee,  subject-matter,  and  con- 
straint factors  in  view  of  the  decision  factors  and  decision 
stages  covered  in  Sections  3 through  5 of  this  report.  These 
attributes  may  include  — presentation  and  response  capabilities 
and  realism  (seeing,  hearing,  reading,  doing);  flexibility  for 
feedback  and  control;  flexibility  for  individual  and  collective 
training-evaluation  usage;  recordkeeping  and  reporting  capabil- 
ities; exportability  or  accessibility;  courseware  development 
and  update  requirements;  facility  requirements;  user  support 
requirements;  relative  costs,  etc.  An  ambiguous  area  in  this 
task  is  availability  of  relative  cost-effectiveness  data. 

2.4  Develop  Delivery  Systems  Selection  Data  Bank 

The  purpose  of  this  task  is  to  develop  a USAFAS  data  file  on 
trainee  characteristics,  subject-matter  characteristics,  and 
delivery  system  attributes  which  will  assist  in  identifying  an 
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optimal  match*  Inputs  to  this  task  will  be  from  priorities  and 
outputs  of  the  prior  three  tasks.  The  data  file  could  take  any 
of  several  forms;  e.g.,  matrices  or  tables  cross  referencing 
task  characteristics  and  trainee  characteristics  to  delivery 
system  attributes,  delivery  system  requirements  forms  to  be 
compared  with  delivery  system  attribute  tables,  etc.^ 

2. 5 Procedurallze  Decision  Stages  of  Model 

The  goal  of  this  task  Is  to  procedurallze  the  decision  steps, 
data  Inputs,  and  Interim  product  outputs  for  each  of  the  four 
delivery  system  decision  stages  of  the  training  development 
life-cycle  proponency  model  shown  In  Figure  4-1  (foldout) 

Section  4.  The  Intent  Is  Input  to  an  Individual-Collective 
Training  and  Evaluation  Plan  (ICTEP)  which  Integrates  system. 
Job,  and  MOS  course  development  products.  Selected  stages 
would  utilize  the  data  file  developed  In  task  2.4. 

These  Step  2 tasks  are  projected  to  begin  concurrently  with  Step  1 for  the 
remainder  of  the  six-month  workplan.  They  would  result  In  the  documentation 
of  specific  data  sources.  Instruments,  procedures,  and  working  formats  to 
operate  the  delivery  system  selection  process. 


^ - Bennlk,  F. , Fallentlne,  B. , Mower,  R. , Joint  Surveillance  System  Training 
Requlresients  Analysis  Study.  SDC  TH-5588  (Vols.  I & II),  31  Oct  1975. 

- Boucher,  B.  G.  et  al.  Handbook  and  Catalog  for  Instructional  Media 
Selection.  Ed.  Technology  Publications,  January  1973. 

- TRADOC  Pam  350-30.  IPISD  Design;  Volume  III  (Block  III. 2),  Aug  1975. 


Step  3 - Pilot  Implementation  and  Formative  Evaluation  at  USAFAS 
The  purpose  of  this  %K>rk  would  be  to  apply  the  delivery  systems 
selection  process  documented  as  a result  of  Steps  1 and  2 to  one 
or  more  sizable  system.  Job,  or  MOS  oriented  training  program  and 
course  development  activities  encompassing  a range  of  Individual- 
collective  training  requirements.  This  will  permit  data  to  be 
gathered  on  the  utility  of  the  delivery  systems  selection  procedures 
against  the  design  and  evaluation  criteria  set  forth  In  Section  4.  A. , 
as  modified  by  subsequent  work.  Lessons  learned  will  be  Incorporated 
Into  the  selection  procedures  and  data  gathered  will  be  added  to  the 
data  sources  developed  In  the  prior  step. 

The  plan  would  be  for  USAFAS  personnel  to  perform  the  selection  tasks 
In  accord  with  the  four  decision  stages  and  products  defined  In 
Section  4 (Figure  4-1)  of  this  report,  and  detailed  In  the  Step  2 
tasks  noted  above.  Initial  workshop  training  would  be  provided, 
followed  by  data  collection  for  USAFAS  application,  and  procedures 
would  be  required  as  Indicated  by  the  evaluation. 

Projected  work  tasks  are  as  follows: 

3.1  Select  ITDT,  Self-Pacing,  or  TEC  Projects  with  USAFAS 

Candidate  MOS  projects  were  mentioned  In  Step  2 (task  2.1) 
above.  Other  candidate  projects  Include  FADAC  maintenance 
and  operation,  SR-56  operation,  and  probable  upcoming  ITDT 
developments  at  USAFAS;  XM-204,  SP  Arty  Total  System,  and 
Towed  Arty  (FY  78-81). 

3.2  Provide  Training  Workshop  for  USAFAS  Personnel 

The  purpose  of  this  would  be  to  familiarize  and  exercise 
USAFAS  developers  in  the  delivery  system  selection  data 
and  procedures  developed  In  Step  2,  using  situational 
problems  for  practice.  The  workshop  Is  estimated  at 
three  weeks. 
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3.3  Determine  Evaluation  Criteria  and  Data  Collection  Procedures 

A plan,  procedures,  and  forms  would  be  developed  to  collect  data 
in  accordance  with  criteria  defined  in  Section  4,  Part  A of  this 
report. 

3.4  Perform  Needs  and  Requirements  Analysis 

USAFAS  developers  would  perform  activities  of  this  phase.  They 
would  make  Stage  1 decisions  on  delivery  systems  mix  and  input 
these  to  the  Individual-Collective  Training  and  Evaluation  Plan 
(ICTEP) . 

3.5  Perform  Front-End  Analysis 

USAFAS  developers  would  perform  activities  of  this  phase,  make 
Stage  2 decisions  on  delivery  systems  mix  and  input  rationale 
and  resource  demands  to  the  ICTEP. 

3.6  Perform  Course  Design 

USAFAS  developers  would  perform  activities  of  this  phase,  make 
Stage  3 decisions  on  delivery  systems  mix  and  provide  specific 
performance  module  rationale  for  the  ICTEP.  In  this  process 
they  would  also  decide  on  the  need  for  alternative  delivery 
systems  in  the  training  setting,  to  correspond  with  trainee 
preference  or  style. 

3.7  Perform  Course  Development 

USAFAS  developers  would  perform  these  activities  in  accord  with 
the  ICTEP.  This  would  Include  developing  lesson,  module,  and 
team  levels  of  proficiency  measures,  as  well  as  training  manage- 
ment guides  appropriate  to  the  training  setting  and  delivery 
system(s}  configuration  decided  in  Task  3.6. 


3«  8 Formative  Implementation 

Following  preliminary  validation,  USAFAS  training  operations 
supervisors  would  be  provided  the  training  delivery  systems  for 
use  In  a realistically  configured  training  setting*  Ihey  would 
conduct  training  and  make  Stage  4 delivery  system  assignments 
In  accordance  with  the  training  management  guides* 

Data  would  be  collected  In  accordance  with  the  data  collection 
plan  (Task  3*3)* 

3*  9 Evaluate  and  Revise 

Data  on  effectiveness,  efficiency,  utility,  acceptance  and  costs 
of  the  delivery  systems  mix  would  be  analyzed,  resulting  In 
revisions  to  procedures  for  delivery  system  selectlon/asslgnment 
as  required*  The  final  product  would  be  a Training  Manager's 
Handbook* 

This  Step  3 work  Is  estimated  to  require  12-18  months  beyond  Steps  1 and  2 depending 
upon  the  magnitude  of  the  system/MOS  program  and  extent  of  evaluation,  and  Its 
Implementation  Is  awaiting  adequate  funding* 
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